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This work considers a many-server queueing system in which im- 
patient customers with i.i.d., generaUy distributed service times and 
i.i.d., generaUy distributed patience times enter service in the order 
of arrival and abandon the queue if the time before possible entry 
into service exceeds the patience time. The dynamics of the system is 
represented in terms of a pair of measure- valued processes, one that 
keeps track of the waiting times of the customers in queue and the 
other that keeps track of the amounts of time each customer being 
served has been in service. Under mild assumptions, essentially only 
requiring that the service and reneging distributions have densities, 
as both the arrival rate and the number of servers go to infinity, a 
law of large numbers (or fluid) limit is established for this pair of 
processes. The limit is shown to be the unique solution of a coupled 
pair of deterministic integral equations that admits an explicit repre- 
sentation. In addition, a fluid limit for the virtual waiting time pro- 
cess is also established. This paper extends previous work by Kaspi 
and Ramanan, which analyzed the model in the absence of reneging. 
A strong motivation for understanding performance in the presence 
of reneging arises from models of call centers. 
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1. Introduction. 

1.1. Background and motivation. We consider a many-server queueing 
system in which customers with independent, identically distributed (hence- 
forth, i.i.d.) service requirements chosen from a general distribution are pro- 
cessed in the order of arrival. In addition, a customer is assumed to abandon 
the queue if his/her time spent waiting in queue reaches his/her patience 
time. The patience times of customers are also assumed to be i.i.d. and 
drawn from a general distribution. When there are servers and the cu- 
mulative customer arrival process is assumed to be a renewal process, this 
reduces to the so-called G/GI/N -|- GI model. 

Over the last couple of decades, several applications have spurred the 
study of many-server models with abandonment [1, 3, 7]. Specifically, in 
applications to telephone contact centers and (more generally) customer 
contact centers, the effect of customers' impatience has been shown to have 
a substantial impact on the performance of the system [7]. For example, 
customer abandonment can stabilize a system that was formerly unsta- 
ble. Under the assumption that the interarrival, service and abandonment 
time distributions are (possibly time- varying) exponential, process-level fluid 
and diffusion approximations were obtained by Mandelbaum, Massey and 
Reiman [16] for the total number in system in networks of multiserver queues 
with abandonments and retrials. 

On the other hand, for the case of Poisson arrivals, exponential service 
times and general abandonment distributions (the M/M/N-l- GI queue), ex- 
plicit formulae for the steady state distributions of the queue length and 
virtual waiting time were obtained by Baccelli and Hebuterne [1] (see Sec- 
tions IV and V.2 therein), whereas several other steady state performance 
measures and their asymptotic approximations, in the limit as the arrival 
rates and servers go to infinity, were derived by Mandelbaum and Zeltyn [18]. 
In addition, approximations for performance measures suggested by these 
limit theorems were used by Garnett et al. [8] and Mandelbaum and Zel- 
tyn [19] for the case of exponential and general abandonment distributions, 
respectively, to provide insight into the design of large call centers. 

In all the previously mentioned works, the service times were assumed to 
be exponential. However, statistical analysis of real call centers has shown 
that both service times and abandon times are typically not exponentially 
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distributed [4, 18], thus providing strong motivation for considering many- 
server systems with general service and abandonment distributions. A step 
toward incorporating more reahstic general service distributions was taken 
in the insightful paper by Whitt [22], where a deterministic fluid approx- 
imation for a G/GI/N + GI queue with general service and abandonment 
distributions was proposed. However, the convergence of the discrete sys- 
tem starting empty to this fluid approximation was left as a conjecture (see 
Conjecture 2.1 in [22]). In this work, we rigorously identify the functional 
law of large numbers or mean-field limit, as the number of servers goes to 
infinity, of a many-server queueing system with general service and abandon- 
ment distributions starting from general initial conditions. In a recent work, 
Mandelbaum and Momcilovic [17] have established diffusion approximations 
for the queue-length and virtual waiting time processes in a G/GI/N -|- GI 
queue. 

With a view to providing a Markovian representation of the dynamics with 
a state space that is independent of the number of servers, we introduce a 
pair of measure-valued processes to describe the evolution of the system. 
One measure-valued process keeps track of the waiting times of customers 
in queue and the other keeps track of the amounts of time each customer 
present in the system has been in service. Under rather general assumptions 
(specified in Sections 2.1 and 3.1), we establish an asymptotic limit theorem 
for the scaled (divided by N) pair of measure-valued processes, as the num- 
ber of servers N and the mean arrival rate into the system simultaneously 
go to infinity. In a recent independent study, Zhang [24] also considered the 
fluid limit for the same G/GI/N + GI system by using a measure- valued 
representation. His approach is based on tracking the "residual" service and 
patience times rather than tracking the "ages" in system and service as 
considered in this work. As in [14] and [15], an advantage of the particular 
measure-valued representation used here, in terms of ages in system and 
service, rather than residual service and residual patience times, is that it 
facilitates the application of martingale techniques, which streamlines the 
analysis and also allows for a more intuitive representation of the dynamics 
of the limiting process. In addition, the measure-valued approach also si- 
multaneously allows for the characterization of asymptotic limits of several 
other functionals of interest. In order to illustrate this point, we also derive 
a limit theorem for the virtual waiting time of a customer, defined to be the 
time before entry to service of a (virtual) customer with infinite patience. 

This work generalizes the framework of Kaspi and Ramanan [14], in which 
the corresponding model without abandonments was considered. The pres- 
ence of two coupled measure-valued processes, rather than just one as in 
[14], makes the analysis here significantly more involved. In addition, an 
important step is the identification of an explicit expression for the cumu- 
lative reneging process. This paper also forms the basis of subsequent work 
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in which we estabhsh, under suitable conditions, the convergence of the sta- 
tionary distributions of the fluid-scaled A^-server systems to the invariant 
state of the fluid limit, as tends to infinity [13]. 

It is worthwhile to mention that the models discussed above are relevant 
when the mean demand of customers is known (or can be accurately learned 
from an initial period of measurements), which is a realistic assumption in 
many applications. In other scenarios, it may be more natural to model the 
demand as being doubly stochastic. This approach was adopted by Harri- 
son and Zeevi [9] (see also [2]), who proposed optimal staffing and design of 
multi-class call centers with several agent pools in the presence of abandon- 
ment under the assumption that the dominant variability arises from the 
randomness in the mean demand, rather than fluctuations around the mean 
demand. 

1.2. Outline of the paper. The outline of the paper is as follows. We 
provide a more precise description of the model and the measure-valued 
representation of the state, and describe the dynamical equations governing 
the evolution of the system in Section 2 (the explicit construction of the state 
process is relegated to Appendix A and the strong Markov property of the 
state process is established in Appendix B). A key result here is Theorem 
2.1, which provides a succinct characterization of the state dynamics. An 
analog of this characterization for continuous state processes leads to the 
fluid equations, which are introduced in Section 3.2 (see Definition 3.3). 
Next, the main results of the paper are summarized in Section 3.3. The first 
(Theorem 3.5) is a uniqueness result that states that (under the assumption 
that the service and abandonment distributions have densities and finite first 
moments) there exists at most one solution to the fluid equations. The proof 
of this result, which is considerably more involved than in the case without 
abandonment, is the subject of Section 4. The second and main result of the 
paper (Theorem 3.6) states that under mild additional assumptions (namely, 
Assumptions 3.1-3.3 introduced in Section 3.1), the scaled sequence of state 
processes converges weakly to the (unique) solution of the fluid equations, 
and provides a fairly explicit representation for the solution. The proof of 
this result consists of two main steps. First, in Section 6, the sequence of 
scaled state processes is shown to be tight and then, in Section 7, it is shown 
that every subsequential limit is a solution to the fluid equations. Both of 
these results make use of properties of a family of martingales that are 
established in Section 5. Finally, the last result (Theorem 3.8) formulates 
the asymptotic limit theorem for the virtual waiting time process, which is 
proved in Section 7.2. To start with, in Section 1.3, we first collect some 
basic notation and terminology used throughout the paper. 
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1.3. Notation and terminology. The following notation will be used through- 
out the paper. Z is the set of integers, N is the set of strictly positive integers, 
M is set of real numbers, M+ the set of nonnegative real numbers and is 
the set of nonnegative integers. For a, 6 G M, a V 6 denotes the maximum of 
a and 6, a A 6 the minimum of a and b and the short-hand a+ is used for 
a V 0. Given ^ C M and a € M, A — a equals the set {x € M : x -|- a € A} and 
1b denotes the indicator function of the set B [i.e., 1_b(2;) = 1 if x (z B and 
'^six) = otherwise]. 

1.3.1. Function and measure spaces. Given any metric space E, Cb{E) 
and Cc{E) are, respectively, the space of bounded, continuous functions and 
the space of continuous real-valued functions with compact support defined 
on E, while C^(£;) is the space of real- valued, once continuously differentiable 
functions on E, and C^{E) is the subspace of functions in C^{E) that have 
compact support. The subspace of functions in C^{E) that, together with 
their first derivatives, are bounded, will be denoted by Cl{E). For H < oo, 
let C^[0,H) and Cl^^[0,H), respectively, represent the spaces of integrable 
and locally integrable functions on [0, H), where a locally integrable function 
/ on [0, H) is a measurable function on [0, H) that satisfies fix) dx <oo 
for all a < H. The constant functions / = 1 and / = will be represented by 
the symbols 1 and 0, respectively. Given any cadlag, real-valued function 
ip defined on [0,oo), we define \\ip\\T = sup^g[o,T] every T < oo, 

and let \\^p\\oo = ^'^Pse[Q,oo)\V'i^)\^ which could possibly take the value oo. 
In addition, the support of a function tp is denoted by supp((^). Given a 
nondecreasing function / on [0,oo), denotes the inverse function of / 
in the sense that 



For each differentiable function / defined on M, /' denotes the first derivative 
of /. For each function f{t,x) defined on M x M", ff denotes the partial 
derivative of / with respect to t, and fx denotes the partial derivative of / 
with respect to x. 

The space of Radon measures on a metric space E, endowed with the 
Borel <T-algebra, is denoted by M{E), while Mf{E), Mi{E) and M<i{E) 
are, respectively, the subspaces of finite, probability and sub-probability 
measures in A4{E). Also, given B < oo, A4<b{E) C A4f{E) denotes the 
space of measures fi in AiF{E) such that \iJ,{E) \ < B. Recall that a Radon 
measure is one that assigns finite measure to every relatively compact subset 
of The space M{E) is equipped with the vague topology, that is, a 
sequence of measures {fin} in M{E) is said to converge to ^ in the vague 
topology (denoted /i„ A fi) if and only if for every (p G Cc{E), 



(1.1) 



f-\y)=mf{x>0:f{x)>y}. 



(1.2) 




as n — > oo. 
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By identifying a Radon measure /x G M{E) with the mapping on Cc{E) 
defined by 

99 1— / ip{x)^{dx), 
Je 

one can equivalently define a Radon measure on £J as a linear mapping from 
Cc{E) into M such that for every compact set JC C E, there exists Lfc < 00 
such that 



ip{x)f-t{dx) 



E 



< -^Acll'/^lloo V99 G Cc{E) with supp((^) C /C. 



On A4f{E), we will also consider the weak topology, that is, a sequence 
in A4i?(-E') is said to converge weakly to fi (denoted fXn —> A*) if and 
only if (1.2) holds for every (f G Cb{E). As is well known, M.{E) and Mf{E), 
endowed with the vague and weak topologies, respectively, are Polish spaces. 
The symbol 6x will be used to denote the measure with unit mass at the point 
X, and, by some abuse of notation, we will use to denote the identically 
zero Radon measure on E. When E is an interval, say [0,H), for notational 
conciseness, we will often write J^[0,H) instead of M([0, H)). For any finite 
measure /j, on [0,H), we define 

(1.3) F^'{x)=n[0,x], x(£[0,H). 

We say a measure fi is continuous at x if and only if fj,{{x}) = 0. 

We will mostly be interested in the case when E = [0, H) and E = [0, H) x 
R+, for some H G (0,cx)]. To distinguish these cases, we will usually use / 
to denote generic functions on [0,H) and ip to denote generic functions on 
[0, H) X By some abuse of notation, given / on [0, H), we will sometimes 
also treat it as a function on [0,H) x M_|_ that is constant in the second 
variable. For any Borel measurable function / : [0, H) — )• M that is integrable 
with respect to ^ G A4[0,H), we often use the short-hand notation 



{f,o= / fimdx). 

J[0,H) 

Also, for ease of notation, given ^ G A4[0,H) and an interval {a,b) C [0,H), 
we will use ^(a, 6) and ^(a) to denote ^((a,6)) and C{{a}), respectively. 



1.3.2. Measure-valued stochastic processes. Given a Polish space Ti, we 
denote by V-^lO, T] (resp., V-^lO, 00)) the space of 'H- valued, cadlag functions 
on [0,T] (resp., [0,oo)), and we endow this space with the usual Skorokhod 
Ji-topology [20]. Then P-^[0,T] and P-^[0, cxd) are also Polish spaces (see 
[20]). In this work, we will be interested in ?^-valued stochastic processes, 
where H = A4f[0,H) for some H <oo. These are random elements that 
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are defined on a probability space P) and take values in ^-^[O,^), 

equipped with the Borel cr-algebra (generated by open sets under the Sko- 
rokhod Ji-topology). A sequence of cadlag, 'H-valued processes, with 

Xn defined on the probability space (r2„,, P^)) is said to converge in dis- 
tribution to a cadlag ?^-valued process X defined on (il, J^, P) if, for every 
bounded, continuous functional F ■.T>-}i[0,oo) — )> M, we have 

hm E„[F(X„)]=E[F(X)], 

n— >oo 

where E„ and E are the expectation operators with respect to the probability 
measures P^ and P, respectively. Convergence in distribution of X„ to X 
will be denoted by Xn =^ X. Let Xk_|_[0, oo) be the subset of nondecreasing 
functions / £ Vu+ [0, oo) with /(O) = 0. 

2. Description of model and state dynamics. In Section 2.1 we describe 
the basic model and the model primitives. In Section 2.2 we introduce the 
state descriptor and some auxiliary processes, and derive some equations 
that describe the dynamics of the state. Finally, in Section 2.3 (see Theorem 
2.1), we provide a succinct characterization of the state dynamics. This char- 
acterization motivates the form of the fiuid equations, which are introduced 
in Section 3.2. 

2.1. Model description and primitive data. Consider a system with N 
servers, in which arriving customers are served in a nonidling, First-Come- 
First-Serve (FCFS) manner, that is, a newly arriving customer immediately 
enters service if there are any idle servers or, if all servers are busy, then 
the customer joins the back of the queue, and the customer at the head 
of the queue (if one is present) enters service as soon as a server becomes 
free. Our results are not sensitive to the exact mechanism used to assign 
an arriving customer to an idle server, as long as the nonidling condition, 
that there cannot simultaneously be a positive queue and an idle server, is 
satisfied. It is assumed that customers are impatient, and that a customer 
reneges from the queue as soon as the amount of time he/she has spent in 
queue reaches his/her patience time. Customers do not renege once they 
have entered service. The patience times of customers are given by an i.i.d. 
sequence, {rj,i € Z}, with common cumulative distribution function C on 
[0, oo], while the service requirements of customers are given by another i.i.d. 
sequence, {vi,i E Z}, with common cumulative distribution function on 
[0, oo). For i G N, Tj and Vi represent, respectively, the patience time and the 
service requirement of the ith customer to enter the system after time zero, 
while {ri,i € — N U {0}} and {vi,i € — N U {0}} represent, respectively, the 
patience times and the service requirements of customers that arrived prior 
to time zero (if such customers exist), ordered according to their arrival times 
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(prior to time zero). We assume that has density g'^ and C, restricted on 
[0, oo), has density g^. This implies, in particular, that ^"(0+) = C(0+) = 0. 
Let 

H'' = sup{x G [0, oo) : /(x) > 0}, 

= sup{x G [0, oo) : g'{x) > 0} 

denote the right ends of the supports of g"^ and g^, respectively. The super- 
script (N) will be used to refer to quantities associated with the system with 
N servers. 

Let E^^^ denote the cumulative arrival process, with E^'^^t) representing 
the total number of customers that arrive into the system with N servers in 
the time interval [0,t]. Also, consider the cadlag, real- valued process 
defined by ajf ^(s) = s if E^^^s) = and, if S(^)(s) > 0, then 

(2.1) af\s) = s-sup{u<s:E'^^\u) <E'^^\s)}, 

which denotes the time elapsed since the last arrival. If E^'^^ is a renewal 
process, then is simply the backward recurrence time process. Also, let 

be an a.s. Z_|_-valued random variable that represents the number of 
customers that entered the system prior to time zero. This random variable 
does not play an important role in the analysis, but is used for bookkeeping 
purposes to keep track of the indices of customers. 

The following mild assumptions on E^^^ will be imposed throughout, 
without explicit mention: 

is a nondecreasing, pure jump process with S(^)(0) = and a.s., for 
t G [0,oo),^W(t) < oo and E(^\t) - E^^^t-) G {0, 1}; 

• the process a^'' is Markovian with respect to its own natural filtration 
(this holds, e.g., when E^^^ is a renewal process); 

• the cumulative arrival process ^W, the sequence of service requirements 
{vj,j G Z} and the sequence of patience times {rj,j G Z} are independent. 

The assumption on the jump size of E^^^ is not crucial and is imposed 
mainly for convenience. On the other hand, the assumed independence of 
the service and patience times is a genuine restriction. It would be of interest 
to consider the case of correlated service and patience times. 

2.2. State descriptor and dynamical equations. As mentioned in Section 
1.1, our representation of the state of the system with N servers involves 
a pair of measure- valued processes, the "potential queue measure" process, 
r/(^) , which keeps track of the waiting times of customers in queue and the 
"age measure" process, which encodes the amounts of time that cus- 

tomers currently receiving service have been in service. In fact, the potential 
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queue measure process keeps track not only of the waiting times of customers 
in queue, but also of the potential waiting times (equivalently, times since 
entry into system) of those customers who may have already entered ser- 
vice (and possibly departed the system), but for whom the time since entry 
into the system has not yet exceeded the patience time. In order to deter- 
mine which subset of these customers is actually in queue, the process 
which represents the total number of customers in system with N servers 
(including those in service and those in queue), is also incorporated into the 
state descriptor. Thus the state of the system is represented by the vector 
of processes (a^\x(^^,z/^^-*,r/^^^), where determines the cumulative 
arrival process via (2.1). The reason for introducing the process rj^^^ into 
the state (rather than working directly with a restricted measure that only 
encodes the waiting times of customers in queue) is that its dynamics is 
decoupled from the service dynamics. It is governed purely by the primitive 
data E^^^ and , and is thus more amenable to analysis (see Remark 2.2 
for further elaboration of this point). Indeed, the queue measure process t]^^-* 
can also be viewed as describing the ages of customers in an infinite server 
queue that has cumulative arrivals E^^^ and i.i.d. service requirements dis- 
tributed according to C. Thus the dynamics of the process t?^^) is also of 
independent interest. 

Precise mathematical descriptions of and z/^^-* are given in Sections 
2.2.1 and 2.2.2, respectively. Some auxiliary processes that are useful for 
describing the evolution of the state are introduced in Section 2.2.3. Finally, 
in Section 2.2.4, a filtration {J~j:^^} corresponding to the system with N 
servers is introduced, and it is shown that the state processes and auxiliary 
processes are all adapted to this filtration. In fact, it is shown in Appendix 
B that the state process is a strong Markov process with respect to this 
filtration. 

2.2.1. Description of queue dynamics. The potential waiting time pro- 
cess Wj^^ of customer j is (for every realization) defined to be the piecewise 
linear function on [0, oo) that is identically zero till the customer enters 
the system, then increases linearly, representing the amount of time elapsed 
since entering the system, and then remains constant (equal to the patience 
time) once the time elapsed exceeds the patience time. More precisely, for 
j E N, if C-^'* is the time at which the jth customer arrives into the system 



after time 0, then for j G N Q ' = {E'-^^)-'^{j) = mf{t > : E(^^t) = j} and 






otherwise. 
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For j € — NU {0}, Wj^^ represents the potential waiting time process of the 
jth customer who entered the system before time zero (if such a customer 
exists). Observe that the potential waiting time Wj^^t) of a customer at 
time t equals its actual waiting time (equivalently, time spent in queue) if 
and only if the customer has neither entered service nor reneged by time 
t. For t G [0,00), let rjl'^^ be the nonnegative Borel measure on [O^H"^) that 
has a unit mass at the potential waiting time of each customer that has 
entered the system by time t and whose potential waiting time has not yet 
reached its patience time. Recall that 5x represents the Dirac mass at x. The 
potential queue measure rjl'^'^ can be written in the form 

(2.3) 



where the last equality holds because at any time t, the potential waiting 
time process of any customer has a right derivative that is positive if and 
only if the customer has entered the system and the customer's potential 
waiting time has not yet reached its patience time. 

For t € [0,00), let Q^^\t) be the number of customers waiting in queue 
at time t. Due to the nonidling condition, the queue length process is then 
given by 

(2.4) Q(^)(i) = [x(^)(t)-iV]+. 

Moreover, since the head-of-the-line customer is the customer in queue with 
the longest waiting time, the quantity 

(2.5) x^""^ (t) = inf {x > : r?f ^ [0, x] > Q(^) (t)} = ( W (Q(^) (t)) 
represents the waiting time of the head-of-the-line customer in the queue at 
time t. Here, recall from (1.3) that F^^ is the c.d.f. of the measure rjl'^^ 
and (-F^* ')~^ represents its inverse, as defined in (1.1). Since this is an 

FCFS system, any mass in r][^^ that lies to the right of X^^HO represents 
a customer that has already entered service by time t. Therefore, the queue 
length process Q^^^ admits the following alternative representation in terms 
of x^^^ ^iid "H^^^ '■ 



FLUID LIMITS OF MANY-SERVERS QUEUES WITH RENEGING 



11 



(2.6) 

2.2.2. Description of service dynamics. Analogous to the potential wait- 
ing process the age process a^^^ associated with customer j is (for 
every realization) defined to be the piecewise linear function on [0, oo) that 
equals till the customer enters service, then increases linearly while the 
customer is in service (representing the amount of time elapsed since en- 
tering service) and is then constant (equal to the total service require- 
ment) after the customer completes service and departs the system. For 
j = —£q^^ + 1, ... ,0, let a^^\o) represent the age of the jth customer in 

service at time and for j € N, we set aj-^^(O) = 0. Due to the First-Come- 
First-Serve (FCFS) nature of the system, customers in service at time t are 
those that did not renege, that have been in the system longer than the 
head-of-the-line customer at time t, but have not yet completed service and 
departed. Therefore, a.s., for j = -£^^^ + 1, . . . ,0, . . .,E^^\t), t > 0, 

ifaf\t) = 0,wf\t)=r„ 
or '{t) = Vj, 

i(af\t) = 0,x^^)it)<wf\t)<r,, 
OT0<af\t)<Vj. 

Note that the condition in the penultimate line of the right-hand side above 
represents the scenario in which a customer enters service precisely at time 
t, which causes x^^^ to have a downward jump at time t since the condition 
that the arrival process increases only in unit jumps ensures that there is at 
most one customer with a given potential waiting time. 

Now, for t € [0, oo), let vj:'^^ be the discrete nonnegative Borel measure on 
[0,H^) that has a unit mass at the age of each of the customers in service 
at time t. Then, in a fashion analogous to (2.3), the age measure uj:^^ can 
be explicitly represented as 



(2.7) 



daf\t+) 
dt 



0, 



1, 



2.2.3. Auxiliary processes. We now introduce certain auxiliary processes 
that will be useful for the study of the evolution of the system. 
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• The cumulative reneging process R^^\ where R^^\t) is the cumulative 
number of customers that have reneged from the system in the time in- 
terval [0,t]; 

• the cumulative potential reneging process S^^\ where S^^\t) represents 
the cumulative number of customers whose potential waiting times have 
reached their patience times in the interval [0, t] ; 

• the cumulative departure process D^^\ where D^^\t) is the cumulative 
number of customers that have departed the system after completion of 
service in the interval [0, t] ; 

• the process K^^\ where K^^\t) represents the cumulative number of 
customers that have entered service in the interval [0,t]. 

Now, a customer j completes service (and therefore departs the system) at 

time s if and only if, at time s, the left derivative of a^-^'' is positive and the 

right derivative of aj^'' is zero. Therefore, we can write 

(2.9) D(^\t)= Eh„ 



{daf ' /dt{s-)>0,da\" > /dt{s+)=0}' 



Note that the second sum in (2.9) is well defined since for each t >0 and 
each j between —£q^^ + 1 and E^^'^{t), the piecewise linear structure of a^^^ 
ensures that the indicator function in the sum is nonzero for at most one 
s € [0,t], that is, there exists at most one s € [0,t] such that the customer 
j completes service at time s. A similar logic shows that the cumulative 
potential reneging process S^^^ admits the representation 

(2.10) S^^\t)= Yl Yl ^{d«,(^'M(«-)>o,d«^'^'M(s+)=o}' 

and the cumulative reneging process R^^^ admits the representation 

(2.11) ^ ^ 



, is)<X^'^Hs-),dw)"> /dt{s-)>0,dw^f> /dt{s+)=0}' 



where the additional restriction Wj^\s) < X^^H^") is imposed so as to only 
count the reneging of customers actually in queue (and not the reneging of 
all customers in the potential queue, which is captured by S^^^). Here, one 
considers the left limit x^^\s—) of x^^^ s-t time s to capture the situation 
in which x^^^ jumps down at time s due to the head-of-the-line customer 
reneging from the queue or entering service. 
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Now, [IjU^'^^) = uj.'^\o,oo) represents the total number of customers in 
service at time t. Therefore, mass balances on the total number of customers 
in the system, the number of customers waiting in the "potential queue" and 
the number of customers in service show that 

(2.12) XW(0) + = X(^) + + R(^\ 

(2.13) (l,r/(^)) + £;(^) = (l,77(^))+5(^) 
and 

(2.14) (1, )) + = (1, + d(^\ 
In addition, it is also clear that 

(2.15) xW = (1,z.W) + qW. 

Combining (2.12), (2.14) and (2.15), we obtain the following mass balance 
for the number of customers in queue: 

(2.16) g(^)(0) + E^""^ = Q(^) + + 
Furthermore, the nonidling condition takes the form 

iV_(i,i.W) = [iV_x(^)]+. 

Indeed, note that this ensures that when X^^\t) < N, the number in the 
system is equal to the number in service, and so there is no queue, while 
if xW(t) > N, there is a positive queue and (1, v'l^^) = N, indicating that 
there are no idle servers. 

An advantage of the measure- valued state representation that we adopt is 
that it allows us to simultaneously study several other functionals of inter- 
est. As an example, we consider the so-called virtual waiting time process, 
which is important for applications. For each t>0, the virtual waiting time 
W^^\t) is defined to be the amount of time a (virtual) customer with infi- 
nite patience would have to wait before entering service if he were to arrive 
at time t. For a more precise definition of l^^'^^^ let t G [0, cxd) and for each 
s € [0, oo), define 

(s) = X] X] '^{dw^.'^^/dt{u-)>0,dw^^^'>/dt{u+)=0} 

(2.17) 

Observe that T^^\s) equals the cumulative number of customers who ar- 
rived before time t and reneged from the queue (before entering service) 
in the time interval [t,t + s]. Once again, for each j there is at most one 
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u (z [t,t + s] for which both indicator functions in the summation are nonzero, 
and so the sum is well defined. The virtual waiting time W^^\t) of a cus- 
tomer at time t is the least amount of time s that elapses after time t such 
that the cumulative departure from the system of customers that arrived 
prior to time t strictly exceeds the queue length at time t. Observing that 
this cumulative departure in the interval [t,t + s] can be due to either de- 
parture from service or reneging of customers that arrived prior to time t, 
we can express the virtual waiting time as 

(2.18) W'^^Xt) = inf{s > : D^^\t + s) - L>(^)(t) + T^^^^s) > Q'^^Kt)}. 

Here, we have used the fact that for all s such that D^^\t + s) — D^^\t) + 

T}^\s) < Q^'^^t), every customer that departed in the time interval [t,t + s] 
must have arrived prior to time t. 

2.2.4. Filtration. The total number of customers in service at time t is 
given by = f|^'*[0, i/*) and is bounded above by N. In addition, 

from (2.13) it follows that 

which is a.s. finite by assumption. Therefore, for every t G [0, oo), a.s., fj^^ G 
Mf[0,H') and £Mf[0,H'). Hence, the state descriptor {Jp,X^^\ 
jyW^ryW) takes values in IR+ x Z+ x Mf[0,H'') x Mf[0,H''). For purely 
technical purposes we will find it convenient to also introduce the additional 
"station process" s^^^ = {sj^\j € Z), defined on the same probability space 
{il.,J-,¥). For each t € [0, oo), if customer j has already entered service by 
time t, then s^^\'t) is equal to the index i € {l,...,iV} of the station at 
which customer j receives/received service and s^^\t) = otherwise. For 
t e [0,oo), let Tj:^'' be the u-algebra generated by 

{4^),x(^)(0),aif)(.),^^)(.),af (.),.f , 
je{-4'^^ + l,...,0}UN,sG[0,t]}, 

and let {J't^^} denote the associated right-continuous filtration, completed 
with respect to P. In Appendix A, an explicit construction of the state 
descriptor and auxiliary processes is provided, which shows in particular 
that the state descriptor {a^^\ X^^\ ) and auxiliary processes are 

cadlag. Moreover, in Lemma A.l, it is proved that the state process V'^^^ = 
{a~P , i^^^^ , ) and the processes EW,QW,5W,i?W,I)(^)and 

are all J-'j^^'* -adapted, and in Lemma B.l, it is shown that {V^^\j-i^'^) 
is a strong Markov process. 
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2.3. A succinct characterization of the dynamics. The main result of 
this section is Theorem 2.1, which provides equations that more succinctly 
characterize the dynamics of the state {a^^\x^^\i'^^\r]^^'') described in 
Section 2.2. First, we introduce some notation that is required to state the 
result. 

For any measurable function if on [0, H^) x ]R+, consider the process 
that takes values in M, and is given by 

(2.19) Z?(^)(i)=E E l{.a(-)M(.-)>oA'-V^*(«+)=o}^(4''^(^)'^) 

for t € [0,oo). It follows immediately from (2.19) and the right continuity of 
the filtration {J^t^^} that d!^^ is { J"^^^"* }-adapted. Also, comparing (2.19) 
with (2.9), it is clear that when 99 is the constant function 1, is exactly 
the cumulative departure process D^^\ that is, 

(2.20) Z)f)=Z)W. 

In an exactly analogous fashion, for any measurable function ip on [0,H^') x 
]R+, consider the process S^^^ that takes values in M, and is given by 

(2.21) 5j^)(t)= iw-)M(.-)>o,..(-)M(.+)=o}^(-r(«)'«)- 

It follows immediately from (2.21) and the right continuity of the filtration 
{J^t^^} that for t G [0, 00), S^^^ is { J'^^^'' }-adapted. Moreover, s[^^ is clearly 
equal to the cumulative potential reneging process 5*^^^ that is, 

(2.22) Sf)=5(^). 

In addition, using (2.12), (2.15) and the nonnegativity of Q^^\ and 
(1,1/^^^), it follows that for any t G [0,oo) and bounded, measurable if, 

(2.23) )(i)|] < ||V9|UE[X(^)(0) +i?(^)(t)] < 00 

and likewise, for each t G [0,oo) and bounded measurable ip, (2.13) shows 
that 

(2.24) )(t)|] < imM^JJ"^) + E^'^Ht)] < 00. 

Next, comparing (2.11) with (2.21), it is clear that the cumulative reneging 
process R^^^ satisfies 

(2.25) i?(^)(t) = 5(5,(t), t>0. 
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where 6^^^ is given by 

(2.26) e^''\x,s) = l[,^^){x^^\s-)), xGM,s>0. 

We now state the main result of this section. For s, r € [0, oo), recall that 
{ip{-+r,s), .f^) is used as a short form for Jj^ ip{x + r, s)i's^\dx), and 
likewise for rj^^\ 

Theorem 2.1. The processes (S(^),X(^),zyW,r/(^)) a.s. satisfy the 
following coupled set of equations: for ip gCI{[0,H^) x ]R_|.) and t € [0,cx3), 

(2.27) 







-Df\t)+j ^{0,s)dK(^\, 
Jlo.t] 



i[o,t] 

for tp eCl{[0,H'') xR+) andte[0,oo), 

(V'(-,t),r/f)) = (V(-,0),r?(^))+ [\M;s)+M;s),vi''^)ds 

(2.28) 

-Sf)(i)+ / ^(0,s)di?(^)(s), 

J[o,t] 

(2.29) X(^) (t) = X(^) (0) + (i) - Z)i^) (t) - ii(^) (t) , 

(2.30) N - {1,4^^) = [N -X'^^\t)]+, 

where K^^^ satisfies (2.14), satisfies (2.25) and d[^^ and S^^^ 

the processes defined in (2.19) and (2.21), respectively. 



are 



Remark 2.2. In the service dynamics, customer arrivals into service are 
governed by the process K'^^'^ , the random duration in service is determined 
by the distribution and departures are represented by D^^\ As cap- 
tured by (2.27) and (2.28), the dynamics of the potential queue is exactly 
analogous, with the customer arrivals now governed by the process 
the random duration of stay in the potential queue determined by C and 
potential departures due to reneging represented by S^^\ Moreover, given 
K^^\ the dynamics of u^^^ are exactly the same as in the case without 
abandonment, which was well studied in [14]. However, in the presence of 
reneging, there is a significantly more complicated coupling between i^^^^ 
and K^^\ as captured by (2.29) and (2.30). In particular, this involves the 
cumulative reneging process R^^\ which has no analogy with any quantity 
in the system without abandonments. Instead, as shown in the sequel [see 
Lemma 5.4, (5.17) and Proposition 7.2], we will exploit the representation 
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(2.25) of R^^^ in terms of the "known" quantity S^^^ in order to characterize 
the Hmit of the scaled sequence of reneging processes. 

Proof of Theorem 2.1. The proof of (2.27) can be carried out in 
exactly the same way as the proof of (5.2) in Theorem 5.1 of [14], since the 
definition of [14] is equivalent to the definition given in (2.8) here 

since daf\t+)/dt = for all j > K^^\t) in [14]. For the reasons mentioned 
in Remark 2.2, the proof of (2.28) is also analogous except that the condition 
that each z^^^"* has total mass no greater than N is replaced by the argument 
below, which shows that each r]l^^ has finite mass. We know that for k = 
0,...,LntJ, 

(l,^!fi)/J < ^^"^ (^) + < E^^'Ht + 1) + (1,.^)- 

Thus, by taking the supremum over /c = 0, . . . , \ nt\ , we have a.s. 
(2.31) sup (l,r?[2i)/J<i?(^)(t + l)+^f)<oo. 

Equation (2.29) follows from (2.12), (2.20) and (2.25), while (2.30) is just 
the nonidling condition formulated in Section 2.2.3. □ 

3. Main results. In this section we summarize our main results. First, 
in Section 3.1, we introduce the fluid-scaled quantities and state our basic 
assumptions. Then, in Section 3.2, we introduce the so-called fluid equations, 
which provide a continuous analog of the characterization of the discrete 
model given in Theorem 2.1. In Section 3.3 we present our main theorems. 
In particular, we show that the fluid equations uniquely characterize the 
strong law of large numbers or "fluid" limit of the many-server system, as 
the number of servers goes to infinity. 

3.1. Fluid scaling and basic assumptions. Consider the following scaled 
versions of the basic processes described in Section 2. For each € N, the 
scaled version of the state descriptor X^^\v'^^\rj'^^^) is given by 

(3.1) a^, {t)=aj^ [t), >{t) = — — — , 

for t£ [0,oo) and any Borel subset B of M+. Analogously, define 

-(N) 

(3.3) I^''> = ^ foi I = E,D,K, Q,R, 3,%. 
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Recall that I^^ [0, oo) is the subset of nondecreasing functions / G V^^ [0, oo) 
with /(O) = 0, H"" = sup{x £ [0, oo) : g^'^x) > 0} and H'' = sup{x € [0, oo) : 
g^{x) > 0}. Define 

^ . ( ie,x,iy,7j)elR^[0,oo)xM+xMF[0,H')xMF[0,H'): 
^'•'^ = [ l-{l,u) = [l-xr 

Sq serves as the space of possible input data for the fluid equations. Our goal 
is to identify the limit in distribution of the quantities (X^-^\ I7W,f?(^)), as 
N —7- oo. To this end, we impose some natural assumptions on the sequence 
of initial conditions (EW,XW(0),4^\r?[,^^). 

Assumption 3.1 (Initial conditions). There exists an 5o-valued random 
variable {E,X{0),T'Q,r]Q) such that, as N ^oo, the following limits hold: 

1. E^^^ -^E in Pir;+[0,oo) P-a.s., and K[E^'^\t)] ^K[E{t)] < oo for every 
t£ [0,oo); _ 

2. XW(0) ^X(O) in M+ P-a.s.; 

3. I7{,^^ 4z7o in MF[0,H'y, 

4. f?[,^) 4f?o in Mf[0,H-), and E[(l,f?J^))] ^ E[(l,r?o)] < oo. 

Remark 3.1. If the limits in (1) and (2) of Assumption 3.1 hold only in 
distribution rather than almost surely, then using the Skorokhod represen- 
tation theorem in the standard way, it can be shown that all the stochastic 
process convergence results in the paper continue to hold. Also, (1) and (4) 
of Assumption 3.1 and (2.30) imply that, for every T € [0, oo). 



oo. 



(3.5) sup supE[X(^)(0) + E^^\t)] < E[l + (l,r?j,^^) + E^^\t)] < 

te[o,T] N 

The next assumption imposes some regularity conditions on t/q and E. 

Assumption 3.2^ For e_ach t > 0, if %({*}) > 0, t_hen ?7o(t, t + e)>0 for 
every e>0 and if E{t) - E{t-) > 0, then E{t-) -E{t - e) > for every 
e>0. 

Remark 3.2. Assumption 3.2 is trivially satisfied if ^^"^ ^ ^o'^" 
tinuous, that is, Voii'^}) — all t > and the function E is continuous. 

In order to state our last assumption, define the hazard rate functions of 
G^' and in the usual manner 

(3.6) H^^x) = -^4p(^y ^eiCif'-), 

(3.7) ^'(") = T^^' 
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It is easy to verify that /i^ and h'^ are locally integrable on [0,H'^) and 
[0,H^), respectively. 

Assumption 3.3. There exists L'^ < such that /i* is either bounded 
or lower-semicontinuous on {L^,H'^), and, likewise, there exists < 
such that /i*" is either bounded or lower-semicontinuous on {L'^,H'^). 

3.2. Fluid equations. We now introduce the so-called fluid equations and 
provide some intuition as to why the limit of any sequence 
should be expected to be a solution to these equations. In Section 7, we 
provide a rigorous proof of this fact. 

Definition 3.3 (Fluid equations). The cadlag function {X,T',r]) defined 
on [0, oo) and taking values in M+ x Mf[0, H'') x Mf[0, H^) is said to solve 
the fluid equations associated with (£■, X(0),I7o, r/g) S <So and the hazard rate 
functions If and /i* if and only if for every t £ [0, oo), 

(3.8) / {h^, f] ds <oo, [ {h^,Vs) ds <oo, 

Jo Jo 

and the following relations are satisfied: for every ip £ Cl{[0,H'') x M+), 

{ip{-,t),Vt) = {<p{-,0),Vo) + {ips{-,s),Vs)ds+ {ip:r{-,s),Vs)ds 

- / {h%-)ipi-,s),Vs)ds+ I ipiO,s)dK{s), 
Jo Jo 

where 

(3.10) K{t) = {l,Vt) - {l,Vo) + [ {h',Vs)ds; 







for every V € C^{[0, i?^) x M+) 

(V'(-,0>^t) = (^^(-,0),%) + / {^psi-,s),f]^)ds+ I {ip^{-,s),r],)ds 



(3.11) 

' {h''{-)i^{;s),fj,)ds+ I i;{0,s)dE{s); 



(3.12) Qit)=X{t)-{l,Vt); 

(3.13) g(t)<(l,7?,); 

(3.14) m= J^(^J^'^^'\'-{iF^^)-Hy))dy^ ds, 
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where we recall that F^'^{x) = r/JO,2;]; 

(3.15) X{t) = X{id) + E{t)- I {h',Vs)ds-R{t) 

Jo 

and 

(3.16) l-(l,I7i) = [l-X(t)]+. 

It immediately follows from (3.12) and (3.16) that for each t € [0,oo), 

(3.17) Q(t) = [X(t)-l]+. 

For future use, we also observe that (3.10), (3.12) and (3.15), when combined, 
show that for every t £ [0, oo), 

(3.18) Q{0) + E{t) = Q{t) + K{t) + R{t). 

We now provide an informal, intuitive explanation for the form of the fluid 
equations. Equations (3.10), (3.12) and (3.15) are simply mass conservation 
equations, that are fluid analogs of (2.14), (2.15) and (2.29), respectively, 
while (3.13) expresses a bound, whose analog clearly holds in the pre-limit, 
as can be seen from (2.6). The relation (3.16) is simply the fluid analog of 
the nonidling condition (2.30). Equations (3.9) and (3.11), which govern the 
evolution of the fluid age measure V and queue measure tJ, respectively, are 
natural analogs of the pre-limit equations (2.27) and (2.28), respectively. It is 
worthwhile to comment further on the fourth terms on the right-hand sides 
of (3.9) and (3.11), which characterize the fluid departure rate and potential 
reneging rate, respectively, as integrals of the corresponding hazard rate 
with respect to the age and queue measures. Note that Vs{dx) represents 
the amount of mass (limiting fraction of customers) whose age lies in the 
range -|- dx) at time s, and h^{x) represents the fraction of mass with 
age X (i.e., with service time no less than x) that would depart from the 
system while having age in [x, x + dx). Hence, it is natural to expect {h^ ,Vs) 
to represent the departure rate of mass from the fluid system at time s. 
This was rigorously proved in the case without abandonments in [14] (see 
Proposition 5.17 therein). By exploiting the exact analogy between (r', K, D) 
and {r],E,S) (see Remark 2.2), it is clear that the potential reneging rate 
at time s can be similarly represented as {h'^,r]g). Thus the fluid potential 
reneging process 5, defined by 

(3.19) S{t)= [ (/i^r/,)ds, tG[0,oo), 

Jo 

represents the cumulative amount of potential reneging from the fluid system 
in the interval [0, t] . Due to the FCFS nature of the system, the fluid queue 
at time s contains all the mass in r/ that is to the left of (-F''»)~^(Q(s)), 



FLUID LIMITS OF MANY-SERVERS QUEUES WITH RENEGING 



21 



where recall F^'> is the c.d.f. of r/^. Moreover, roughly speaking, given any 
y G [0, Q(s)] , there is a mass of dy customers in the queue whose waiting time 
at s is {F^'')~^{y) and the mean reneging rate of customers with this waiting 
time is N" {{F^'>)~^{y)). Thus the total actual reneging that has occurred in 
the interval [0,t], is represented by the integral, as specified in (3.14). 

We close the section with a simple result on the action of time-shifts on 
solutions to the fluid equations. For this, we need the following notation: for 
any t G [0, oo), 

= E{t + -)- E{t), = K{t + ■)- K(t), 

XM=X(t + .), I7W=I7,+., 

R\t] = R[t + .) - R{t), r?M = QM = Q{t + •). 



Lemma 3.4. Suppose the cadlag function {X,17,r]) defined on [0,oo) and 
taking values in x j\4f[0,H'^) x A4f[0, H'^) solves the fluid equations as- 
sociated with X(0),I7o, tJo) g5o, then (XW,!7W,r/W) solves the fluid equa- 
tions associated with {E^^\x{t), Vt,r]t)eSo, where A'W,i?M,QW are the cor- 
responding processes that satisfy (3.10), (3.14), (3.12) withV^^\ rf^ and X^^^ 
in place ofV, T] and X . 

The proof of the lemma just involves a rewriting of the fluid equations, 
and is thus omitted. 



3.3. Summary of main results. Our first result establishes uniqueness of 
solutions to the fluid equations. 

Theorem 3.5. Given any (E,X{0),T'Q,r]Q) (zSq, there exists at most 
one solution {X,T',r]) to the associated fluid equations (3.8)-(3.16). More- 
over, ifV andrj satisfy (3.8), then {X ,17,7]) is a solution to the fluid equations 
if and only if for every f € C;,(M+), 



(3.20) 



f{x)rj,{dx) = [ f{x + t) \ ^^!:^,'^S oidx) 

[0,H^) J[0,W) 1 - Lr [X) 



+ [ f{t-s){l-G'it-s))dEis), 
J\o.t] 



(3.21) 



f{x)Vt{dx) = [ f{x + t) '^~^y,^S ,{dx) 
[o,H^) -'[o,/f») 1 - G {x} 



+ [ f{t-s)il-G%t-s))dKis), 
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where 

K{t) = [X{0)-l]+-[X{t)-l]+ + E{t) 
(3.22) _ 



\Jo 



and for all t G [0,oo), X satisfies [X{t) — l]"*" < (l,r/J, the nonidling condi- 
tion (3.16) and 

X{t) =X{0) + Eit) - [ {h',Us)ds 
(3.23) _ ^° 

h^{F^^)-Hy))dy]ds. 



VJO 



Moreover, K also satisfies 

^/ ^ ^ ^ /■ (x + t - s) - (x) 

J[o,H-) l-G'{x) 



(3.24) + (^{l,Vt^s) - {l,Vo) 



+ / — '-^Mdx)\u%s)ds, 

J[o,H-) l-G^(x) J 

where is the density of the renewal function associated with (u" 
exists since G* is assumed to have a density). 



Next, we state the main result of the paper, which shows that, under 
fairly general conditions, a solution to the fluid equations exists and is the 
functional law of large numbers limit, as N ^ oo, of the A^-server system 
with abandonment. 



Theorem 3.6. Suppose that Assumptions 3.1-3.3 hold, and let {E,X{Q), 
1^0)%) ^ "^o he the limiting initial condition. Then there exists a unique solu- 
tion {X,T',rj) to the associated fluid equations, and the sequence 
rj^^^) converges weakly, as N ^oc, to (X,!7,r/). 



Theorem 3.6 follows from Theorem 6.1, which establishes tightness of the 
sequence }, Theorem 7.1, which shows that any subsequen- 

tial limit of the sequence } satisfies the fiuid equations, and 

the uniqueness of solutions to the fluid equations stated in Theorem 3.5. 
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Corollary 3.7. Suppose that Assumptions 3.1-3.3 hold. Given any 
{E, X(0),!7o, t/q) € 5o, let (X, 17,77) be the unique solution to the associated 
fluid equations (3.8)-(3.16) specified in Theorem 3.5. If the function E is 
absolutely continuous and Vq and tjq are absolutely continuous measures, 
then the function X is also absolutely continuous and for every t € [0,oo), 
the measures Vt and rj^ are also absolutely continuous. 

Proof. Since E is absolutely continuous, (3.23) allows us to deduce that 
X is absolutely continuous. In turn, (3.22) shows that K is also absolutely 
continuous. Then the argument used in proving Lemma 5.18 of [14] can 
be adapted, together with (3.20) and (3.21), to show that vt and rj^ are 
absolutely continuous for every t G [0, 00). This proves the corollary. □ 

We now state the fluid limit result for the virtual waiting time process 
W^^\ This result is of particular interest in the context of call centers. Note 
that in the fluid system, for any u>t the total mass of customers in queue 
at time u that arrived before time t equals Q{u) — T7„[0,ti — t], and the ages 
of these (fluid) customers lie in the interval [u — t,x(n)], where 

(3.25) x{u) = {F^^)-\Q{u)). 

Observe that this definition is analogous to the definition of x^^'^ given in 
(2.5). Therefore, by the same logic that was used to justify the expression 
(3.14) for R in Definition 3.3, it is natural to conjecture that, for each t G 

[0, 00), the fluid limit of the sequence {T^^'*} equals Tj, where for s G [0, 00), 

_ f-t+s / rQ(u) _ \ 

Tt{s)= I { h^{{F^-r\y))dy]du 

Jrj^[Q,u-t\ J 
Qit+u) _ \ 

h''{{F'^t+uy\y))dy]du. 

(3.27) Tr(t) = inf|s>0:^^ + Tt(s) > Q(t)| . 

We will say a function / G P[0,oo) is uniformly strictly increasing if it is 
absolutely continuous and there exists a > such that the derivative of / is 
bigger than and equal to a for a.e. t G [0, 00). Note that for any such function, 
f~^{f{t)) =t and f~^ is continuous and strictly increasing on [0, cxd). We 
now characterize the fluid limit of the (scaled) virtual waiting time in the 
system. 

Theorem 3.8. Suppose that the conditions of Theorem 3.6 hold and that 
the function J^ih^ ,Vu) du is uniformly strictly increasing. For each t > 0, if 

Q is continuous at t, then T^^^ ^Tt and W'^^\t) ^W{t), as N ^00. 



(3.26) 



Also, define 
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4. Uniqueness of solutions to the fluid equations. In Section 4.1, we show 
that if (X,z7,7j) solve the fluid equations associated with a given initial con- 
dition {E, X{0),T'Q,r]Q) S So, then V (resp., r]) can be written explicitly in 
terms of the auxiliary fluid process K (resp., cumulative arrival process E). 
In Section 4.2, these representations are used, along with the nonidling con- 
dition and the remaining fluid equations, to show that there is at most one 
solution to the fluid equations for a given initial condition. 

4.1. Integral equations for (V, K) and (fj, E). We begin by recalling The- 
orem 4.1 and Remark 4.3 of [14], which we state here as Proposition 4.1. 
This proposition identifies an implicit relation that must be satisfied by the 
processes (T'tK) and (j]-,E) that solve (3.9) and (3.11), respectively. 

Proposition 4.1 [14]. Let G he the cumulative distribution function of 
a probability distribution with density g and hazard rate function h = g/{l — 
G), /et = sup{x G [0, oo) : g'(x) > 0}. ^wppose vf € P_^^[o,i?)[0) °o) has the 
property that for every m G [0, H) and T S [0, oo), there exists G{m, T) < oo 
such that 

/•oo 

(4.1) / {ip{;s)h{-),7r,)ds<G{m,T)\\ip\\^ 

Jo 

for every G Cc(M^) with supp((/9) C [0,m] x [0,T]. Then given any ttq € 
Mf[0,H) and Z€Xk^[0, oo), vf satisfies the integral equation 



(¥'(•, i),7i"£) = ((/?(•, 0),7ro) / {(fs{-,s),TTs)ds+ I {(fxi-,s),7rs)ds 

(4.2) 



{(p{-,s)h{-),7rs) ds + I (p{0,s)dZ{s) 

m 



for every if G Cc((— oo, H) x M) and t € [0, oo), if and only if ir satisfies 
(4.3) 



fix)Wtidx) = [ f{x + t)l-^i^vfo(dx) 

[0,A/) J[0,M) l-Cr^Xj 



+ / f{t-s){l-G{t-s))dZ{s), 
J\o.t] 

f € Cfe(M+) and t G 

t € (0,oo) 



for every f € Cfe(]R+) and t £ (0, oo). Moreover, for every f € C^(]R+) and 



f f{t-s){l-G{t-s))dZ{s) 
Jo 



(4.4) =f{0)Z{t)+ f'(t-s){l-G{t-s))Z{s)ds 

Jm 



FLUID LIMITS OF MANY-SERVERS QUEUES WITH RENEGING 25 

- / f{t-s)g{t-s)Z{s)ds. 
J[0,t] 

Fluid equations (3.8)^(3.11) show that (4.1) and (4.2) are satisfied with 
{h,W,Z) replaced by {h^,T',K) and {h^,r],E), respectively. Therefore, the 
next result follows from Proposition 4.1. 

Corollary 4.2. Processes (r?,^) and {V,'K) satisfy (3.20) and (3.21) 
for every hounded Borel measurable function f and t G [0, oo). Moreover, K 
satisfies the renewal equation 

-J.,,. /■ G'{x^t)-G'{x)_ ,^ . 

(4.5) 

+ / g'it- s)K{s)ds 
Jo 

for each t>0 and admits the representation 



K{t)= {{l,ut^s)-{l,'^o))dU'{s) 
J[o,t] 

r ff G%x + t-s)-G%x)_ .\ ^ 
+ / — T^jr^ —Mdx) dU'{s), 

where dU^ is the renewal measure associated with the distribution 



Remark 4.3. Strictly speaking, in [14] the cumulative distribution func- 
tion G was assumed to be absolutely continuous and supported on [0,oo). 
However, the proofs given there only use the local integrability of the haz- 
ard rate function h on [0, H) and so continue to hold for C here, which 
may possibly have a positive mass at oo. In fact, in the case that C" has 
a positive mass at oo the hazard rate function h"^ is globally integrable on 

4.2. Uniqueness of solutions. Let (X, 17, rj) be a solution to the fluid equa- 
tions associated with {E,X{0),T'Q,rjQ). Recall the definitions of Q and R that 
are given in (3.12) and (3.14). As an immediate consequence of (3.14), we 
have the following elementary property. 

Lemma 4.4. For any < a < 6 < oo, if Q(t) = for all t G [a, h], then 
R{b)-R{a) = 0. 

Next, we establish the intuitive result that the process K that represents 
the cumulative entry of "fluid" into service is nondecreasing. 
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Lemma 4.5. The function K is nondecreasing. 



Proof. Fix t G [0,oo) and < s < t. If X{t) > 1, then {l,Vt) = 1 > 
{IjVs) by (3.16). Hence, by (3.10), it follows that 



li X(t) < 1, we consider two cases. 

Case 1. X{v) < 1 for all v G {s,t]. In this case, by (3.12) and (3.16), 
Q{v) = for all V € {s,t]. Hence, by Lemma 4.4 and the right continuity of 
R, R{t)-R{s) = 0. By (3.18), it then follows that 



Case 2. There exists v € {s,t] such that X{v) > 1. Define / = sup{t' < 
t:X{v) > 1}. Then, clearly / G {s,t] and X{1-) > l.J^ow, (3.14) implies 
that R is continuous and hence, by (3.15), X{v) — X{v—) > for every 
V G (0, oo). Therefore, X{1) > 1 = (1,17;), with the latter equality being a 
consequence of the nonidling condition (3.16). Due to the case assumption 
X(t) < 1, we must have I < t. Then (4.6), with t replaced by /, shows that 
K(/) -Kis) > 0. On the other hand, since X{v) < 1 for all v G {l,t], the 
argument in case 1 above shows that K{t) — K{1) > 0. Thus, in this case 
too, we have 'K{t) - K{s) > 0. □ 

We now state the main result of this section. 

Theorem 4.6. For i = 1,2, let {X\Tf,7f) be a solution to the fluid 
equations associated with {E,X{0),17Q,r]Q) G Sq. Then X^ = X'^,1j^ =17^ and 

1 _2 

rj =r] . 

Proof. For each i = 1,2, let Q\K\D\R^ be the processes associated 
with the solution {X'^,i^,rf) to the fiuid equations for (i?, X(0), z/q, ?7o) G Sq. 
It follows directly from Corollary 4.2 that rj^ = rf . Let l\A denote A'^ — A^ for 
A = Q,K ,D,R and V. For each t > 0, let AVt be the measure that satisfies 
AVt^E) = iy^{E) — ul^E) for every measurable set H C [0,oo). Choose 6>0 
and define 



We shall argue by contradiction to show that t = oo. Suppose that r < oo. 
We first claim that for each t G [0,t], 



(4.6) 




K{t) - K{s) = K{t) - K{s) + R{t) - R{s) + Q{t) - Q{s) 
= E{t)-E{s) 



>0. 



T = Ts = inf {t > : AK{t) V AK{t-) > 6}. 



(4.7) 



AK{t)<6 



if (1,17,1) = 1. 
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To see why this is true, suppose that (1,1^1) = 1 for some t € [0,r]. Since 
(1, < 1, we have (1, Auf) < 0. When combined with (4.5) and the identity 
Ai^o = 0, this shows that 

(4.8) AK{t) = {l,AVt)+ [ g'{t- s)AK{s)ds< [ g' {t - s) AK {s) ds . 

Jo Jo 

If G^(t) > then, along with the fact that AK^s) < 6 for ah s G [0,t), this 
imphes AK{t) < 5^(1) < 6. On the other hand, if G^(t) = 0^ it must be 
that g%s) = for a.e. s G [0,t] and so (4.8) imphes that AK{t) = < 6. 
Thus (4.7) fohows in either case. In addition, the right-continuity of and 
imphes that AK{t) > 6. When combined with (4.7), (3.12) and (3.16), 
this shows that 

(4.9) X\t) = {l,vl) < 1 and Q\t) = 0. 
Now, define 

r = sup{t<T:Q^{t) <Q^(i)} VO. 

Then for every t G [r,r], Q'^{t) > Q\t). If r = 0, then AK(r) = AK{0) = 
< 6. On the other hand, if r > 0, there exists a sequence of {tn}'^=i such 
that tn < r and t„ ^> r as n ^ oo and < Q'^{tn) < Q^{tn) for each n G N. 
Since and are cadlag, this imphes that 

(4.10) Q^(r-)<Q\r-), 

and, due to (3.12) and (3.16), it also follows that X^{tn) > {l^vl^J = 1 for 
every n G N. When combined with (4.8), this shows that for n G N, 

rtn rtn 

AK(tn)< g'{tn-s)AK{s)ds= g'{s)AK{tn - s)ds. 
Jo Jo 

Since and are cadlag, this implies that 

AK{r-)< / g\s)AK{{r-s)-)ds. 
Jo 

Using the fact that AK{{r — s)—) <5 for all s G (0, r), it is easy to see [once 
again, as in the analysis of (4.8), by considering the cases G*(r) > and 
(r) = separately] that this implies 

(4.11) AK{r-) < 6. 

On the other hand, since (3.18) is satisfied with {K,R,Q) replaced by 
(K\R', W) for i = 1,2, and AQ(0) + A'E{t) = for each t > 0, it follows 
that 

AK{t) + AR{t) + AQ{t) = AK{r-) + AR{r-) + AQ(r-) = 0. 
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Hence, 

AK{t) - AK{r-) = -(A7?(t) - AR{r-)) - AQ(t) + AQ(r-). 

Since -AQ{t) = Q1(t) -Q^(t) = -Q^{t) < due to (4.9) and AQ{r-) < 
by (4.10), we obtain 

(4.12) AK(t) - AK{r-) < -(Ai?(r) - AR{r-)). 

We now show that the right-hand side of the above display is nonpositive. 
For each t > 0, by (3.14), we see that 

AR{t) =lf{t)-R^{t) 



—1 —2 

Since rj =r] , it follows that F ' = F ' . Together with the continuity of R 
and R^, this yields the equation 

AR{t) - AR{r-) 



(4.13) 



AR{t) - AR{r) 



h'{{F'^T\y))dy]ds 







However, by the definition of r, for each t G [t,t], Q'^{t) > Q^(t), and so 
A'R{t) - AR{r-) > 0. Together with (4.12) and (4.11), this implies 

AK{t) <AK{r-) <d. 

Essentially the same argument can be used to also show that AK{t—) < 
AK{r—) < 6. Hence AK(t) V AK(t—) < 6, which contradicts the definition 

of T. 

Thus we have proved that r = oo and K (t) — K^{t) < 6 for each 6 > 
and t > 0. By letting 6^0, we have K'^{t) < 'K^it) for all i > 0. An exactly 
analogous argument yields the reverse inequality K (t) < K'^{t) for each 
t > 0, and so it must be that K"^ = . By Corollary 4.2, it follows that 

=17^. Also, by (3.18), we obtain 
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We now show that, in fact = and = B? . If there exists t € (0, oo) 
such that Q^{t) >Q'^{t), let 

s = sup{v <t:Q^{v) <Q^(u)} VO. 

Then Q^(s-) < Q^(s-) and Q^{v) >Q^{v) for each v G {s,t]. Due to the 
fact that T]^ ='rf , we have 



From (4.14) and the continuity of ii*, « = 1, 2, we deduce that Q^{t) — Q^{s—) < 
Q'^{t) — Q'^{s—). Combining this with the inequahty Q^{s—) < Q'^{s—) proved 
above, we obtain Q^{t) < Q'^{t), which leads to a contradiction. Hence Q (v) < 
Q'^{v) for all V S (0, oo). By symmetry, we can also argue that Q^{v) > Q'^{v) 
for all V G (0, oo). This shows = and, hence, = R?. Finally, by 
(3.12), we have XI =X2. □ 

Proof of Theorem 3.5. The first statement in Theorem 3.5 follows 
from Theorem 4.6. The second statement follows directly from Corollary 
4.2 and the fluid equations (3.12), (3.14), (3.15) and (3.17). The alternative 
representation (3.24) for K \s a, direct consequence of the renewal equation 
(4.5) and the fact that the first three terms on the right-hand side of (4.5) 
are bounded by one. □ 

Remark 4.7. For future use, we observe here that the result of Lemma 
5.16 in [14] (and the analog with V replaced by rj), which was obtained for 
the model without abandonments, is also valid in the present context. This 
is because equations (3.20) and (3.21) of Theorem 3.5 and Corollary 4.14 
of [14] show that, in the terminology of [14], {fjg\ (resp., {Vg}) satisfies the 
simplified age equation associated with a certain Radon measure ^(t^q, E) 
and N' [resp., ^(l^o, K) and h'^]. Therefore, by Proposition 4.15 of [14], it 
follows that the result of Lemma 5.16 of [14] is also valid in the present 
context. 

5. A family of martingales. In Section 5.1, we identify the compensators 
(with respect to the filtration J-j:^^) of the cumulative departure, potential 
reneging and (actual) reneging processes. Then, in Section 5.2, we establish a 
more convenient representation for the compensator of the reneging process. 





R\t)-R\s). 
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5.1. Compensators. For any bounded measurable function if on [0, H^) x 
M+, consider the sequence {^^''} of processes given by 

(5.1) AW(t)=/Y/ ^{x,s)h'ix)i.i^\dx))ds, te[0,oo). 

Jo \J[0,H'>) J 

Likewise, for any bounded measurable function Lp on [0, if^) x M_|_ and S N, 
let 

(5.2) 4^^)(t)=/Y/ ^{x,s)h:-{x)rlP{dx)\ds, t€[0,oo). 

In Proposition 5.1, we show that (resp., ^^■') is the J^^^'^^ -compensator 
of the associated "(/?- weighted" cumulative departure process Z)^^^ (resp., 
s!^^). A similar result was established in [14] for the model without aban- 
donments. However, the filtration {J'f^^} considered here is larger than the 
one considered in [14], and so Proposition 5.1 does not directly follow from 
the results in [14]. 

Proposition 5.1. The following properties hold: 
1. For every bounded measurable function ip on [0,if^) x M^, such that the 



function s ^ ip{a - (s),s) is left continuous on [0,oo) for each j, the 

(TV) 



AN) 

process M^^J defined by 
(5.3) Mil)=Dl^)-m 



is a local -martingale. Moreover, for every € N, t G [0, oo) and 



(5.4) |AW(t)| < y\UX^^\0) + E^^\t))(^l^"^h%x)dx^<^ 

for every ip € Cc{[0,H^) x M^) with supp{ip) C [0,m] x M^. In addition, 
the quadratic variation process (m'^J) of the scaled process 
M^^J /N satisfies 

(5.5) hm n(M\^Jm\ = 0; M[^J ^0 as iV ^ oo. 

2. Furthermore, properties (5.3)-(5.5) also hold with D^Oj^u^H^ and , 
respectively, replaced by S,Wj,r],H^ and . 

Proof. In Lemma 5.4 and Corollary 5.5 of [14], it was shown that 
A^tp^J is the compensator of D^^"* with respect to a certain filtration. The 
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filtration {J~t'^^} that we consider here is larger than the filtration used in 
[14] since it also includes the cj-algebra generated by the potential waiting 

times {r]f\s),s <t,j = -f'i^^ + 1, • • • , E^^\t)}. Thus the results of [14] do 
not directly apply here. Nevertheless, as we prove below, the result continues 
to hold due to the assumed independence of the patience and service times. 
We first claim that for every J-'^'-'^^ -stopping time T, 

IE[l{efc<i/2™<T,cfc>i/2™}l{c,'s<(i+i)/2™}l-^]J^L] 

(5.6) 



where 9^ (resp., Cn) is the time at which the nth customer to be served 
at station k starts (resp., completes) service. Then Cn - 0n is the service 
time of the nth customer to be served at station k, which has cumulative 
distribution function . In order to show the equality in (5.6), it suffices 

to show that for every bounded -adapted random variable H, 

E[i?l{gfc<jy2™<T,C^>i/2™}l{C^<(j+l)/2™}] 

(5.7) 



^'^{e'f,<j/2^<r,(^i^>i/2^} I ' — —du 



^72" 



For i € N, m e N, define ^j/^L be the cr-algebra to be generated by the 
events {(0^ < x) n (6*^ < Cn > 2^); 2; > 0}. In particular, ^j^L contains 

the information of the ages of all customers in service at time Recall 
that the patience times and the service times of customers are assumed to 
be independent. Therefore, given ^^-^L, Cn ~ ^'^d conditionally 
independent. Hence, it follows from the left-hand side of (5.7) that 

E[/71|efc<j/2-<T,C^>i/2-}l{C*;<(j+l)/2™}] 

= E[E[i?l|^-/2'»<T}l{e^<j/2™,C^>i/2™}l{C^-0fe<(j+l)/2™-efe}l^^^'' 



i/2" 



E[E[//l|,-/2™<T}|e]72™ 



X ^^[l{e.<i/2™,C^>i/2'"}l{C^-e.<(i+i)/2™-ejl^j72'"]] 



and 



^[^{9^i<i/2"SC^>j/2™}l{c^-e;<(i+i)/2'"-efc}l^j/i-] 



1 f^'^'""^ ''^^-'"^ du 
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Therefore, 



,(7V) 



(N) 



E[E[i^l|jy2™<T}l^jy2-]lE[l{e^<j/2™,C^>i/2-}l{C^-efe<(j+l)/2™-efe^ 



:E 



E[//l|j/2'"<T}l^]/^L]l{6l^<j/2™,C^>j/2™} 



'nl 



l-G-(j/2--0^) 



:E 



E 



{j/2™<T}l{efc<j72'»,Cfe>i/2™} 



{i+l)/2" 



l-G-O72™-0^) 



:E 



^^l{j/2™<T}l{e^<j/2'",C^>i/2'"} 



^i/2" 

™(i+l)/2'" 

This shows that (5.7), and therefore (5.6), holds. 

km. 



du 



If if is bounded, measurable and such that the function s 99(0^- (s), s) 



is left continuous for each j, then the process {ip{aj^\s),s),s > 0} is Tf 
predictable. Therefore, it follows from the standard theory (cf. Theorem 3.18 
of [10]) that Miff is a local J-'^f^-' -martingale. Inequality (5.4) can be estab- 
lished exactly as in Proposition 5.7 of [14] and assertions (5.5) can be proved 
using the same argument as in Lemma 5.9 of [14], thus establishing prop- 
erty (1). Due to the analogy between the service dynamics and the potential 
queue dynamics (see Remark 2.2), property (2) is a direct consequence of 
property (1). □ 



AN) 



Remark 5.2. It is easy to see that Lemmas 5.6 and 5.8 of [14] continue 
to be valid in the presence of abandonments. Indeed, the proofs of Lemmas 
5.6 and 5.8 of [14] only depend on Assumption 1 and Corollary 5.5 therein 
(since, as shown in Lemma 5.12 of [14], the additional conditions (5.32) 
and (5.33) of Lemma 5.8 of [14] can be derived from Assumption 1), which 
correspond to Assumption 3.1 and Proposition 5.1 of this paper. In addition, 
due to the parallels between the dynamics of u^^^ and jy*-^-* (see Remark 2.2), 
the analogs of the results in Lemmas 5.6 and 5.8, with D^^\v^^\G^ and 

, respectively, replaced by S^^\r]^^\G^ and H^, also hold. In this case, 
even though rjff is (unlike i^q^^) not necessarily a sub-probability measure, 
the verification of the conditions analogous to (5.32) and (5.33) of Lemma 
5.8 in [14] can still be carried out in the same manner since Assumption 
3.1 implies that the sequence {{l,r]ff)} is tight. Moreover, even though 
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C is allowed to have a mass at oo, the proofs of Lemmas 5.6 and 5.8 
are still valid, with the renewal function now replaced by the function 
^^(■) — /o where ((7'')*" is the nth convolution of g"^ on 

[0,00). 

Now, note from (2.25) that fi(^) = S^^J^, where 6'(^) is defined by (2.26). 
In view of the fact that A^^-* is the compensator for it is natural to 

conjecture that the compensator of i?*-^-* is equal to ^^^) ^, where 

(5.8) ^ ° ^"'""^^ 

t G [0,00). 

However, this is not immediate from Proposition 5.1(2) since 6''^\'Wj^\-) , •) 
is not left continuous for any j. Instead, we approximate by a sequence 
{^'^/f^jAfeN defined by 

(5.9) 0l^^ {x,s) = l(,_i/„„oo) (X^^^ (s-)) , 

which is shown to be left continuous in Lemma 5.3. Then in Lemma 5.4, we 
use an approximation argument to show that A^J^n) ^ is indeed the compen- 
sator of R^^\ 

Lemma 5.3. For each m > 1, x € M and s G ]R-|_, the sequence {Om^}j\[^fq 
defined by (5.9) satisfies the following two properties: 

1. For every E N, x S M, s € M, 6^'^ (x, s) is nonincreasing in m and con- 
verges, as 00, to 6^^\x,s) for every sample point in 0. 

2. For each A^, m G M, j G Z, the process 6m\wj^\-), •) has left continuous 
paths on (0, 00). 

Proof. The first property is immediate from the definition of 
For the second property, fix A^, m G N, s > 0, j € Z and w € To ease the 
notation, we shall suppress uj from the notation. Let {sn} be a sequence in 
(0, 00) such that Snt ^ as n — )• cxj. We now consider two mutually exclusive 

Case 1. ei!!\wf\s),s) = 1. Then wf\s) < x^^Hs-) + l/m. Since wf^ 

is nondecreasing, Wj^^ (s„) < Wj^'^ (s) and since the process {x^^-* {s—),s > 0} 

is left continuous, we have, for all n large enough, Wj^\sn) < X^^Hsn—) + 

1/m. Hence, 0^\wj^\sn),Sn) = 1 for all n gN. Thus, in this case, 6m\w^^\ 
is left continuous at s. 
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Case 2. ei!!\wf\s),s) = 0. Then wf\s) > x^^Hs-) + 1/m. It follows 
from Lemma A. 2 that for all sufficiently large n, x^^\s—) — X^^\sn—) = 
s — Sn > 0. Since (2.2) implies Wj^\s) — Wj^\sn) < s — Sn for all n € N, 
this implies 'Wj^\sn) > X^^Hsn—) + for all n large enough. Hence, 
dm\wj^\sn),Sn) = and 6m\wj^\-), •) is again left continuous at s. □ 

Lemma 5.4. For every € N, the process M^^J~^ defined by 

is a local J^j:^^ -martingale. In addition, as N ^ oo, 
(5.11) E[(mS, J(i)]^0, M^^^UO an^i ^ 0. 



Proof. Fix iV e N, and let A^fl , m G N, be defined in the obvious 
way 

(5.12) ^(fj, W=/Y/ 4^)(x,.)/i'^(x)r?(^)(d:r)')d.. 

By Proposition 5.1(2) and Lemma 5.3(2), the process ^^^) is the T^f^^ - 
compensator of the process S^^J-j , and the process defined by 

dm dm, ,r) 

Wm ,»? t/m ,V 

is a local /'^''^''-martingale. Now, by Lemma 5.3(1), Om'^ — t- 6^^^ pointwise 

on Rl, \9^r!^\x,s)-9^^\x,s)\ < 1 for all (x,s) gM^, and ^[^^^^(t)] < oo, 

E[A^^^(t)] < oo for all t G (0, oo). Hence, an application of the dominated 
convergence theorem shows that for all t G (0, oo), as m — > oo. 



E 

and 



supl^^fi (,)_A(fj (.)! 

0<S<t <^m \V 



E 



sup IS^fJ^is) - Sj.fj^is)] 

^0<S<t dm 



0, 



and hence M^^J^ converges in distribution to M^^J^ . Since \S^^J^{t) — 

dm dm 

S^^J^{t—) \ < 1 for all t G [0,oo) and m G N, we conclude that M^^J^ is a 

dm 

local J-'^^^'' -martingale by Corollary 1.19 of Chapter IX of [10]. Given that 
M^^J^ is a martingale, the proof of the limits (5.11) is exactly analogous 
to the proof of (5.5), as carried out in Lemma 5.9 of [14]. □ 
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5.2. An alternative representation for the compensator of R^^\ We now 
derive an alternative, more convenient representation for A^^^^ ^, or more 

generally, for processes of the form ^^^) , but with replaced by an 

(JV) 

arbitrary measurable function h. In what follows, recall that F^t (x) = 
r/|^''[0,x] and its inverse {F'^^ ')~^ is as defined in (1.1). 

Proposition 5.5. For each € N, i > and measurable function h on 



(5.14) 

where 

(5.15) L^^\t) = 



1,0 (N)u_)i{x)h{x)7]l'^\dx) 

Q(A^)(t)+,{A^)(t) 

h{{F^^ )-\y))dy, 



0, ^/ (x^^Hi-) - x'^'^HmK^'^Ht) - K(^\t-)) = 0, 

1, ^f{x^''Kt-)-x^^\t)){K^^){t)-K(^){t-))>0. 



Proof. Fix N e'N, t>0 and a measurable function h on [0,H^). By 
the representation (2.3) for r]l^\ we have 

l[o,y(iv)(t-)i {x)h{x)r]l^\dx) 

l[0,Hr) 

(5.16) 

Moreover, by (2.6), 

Q(^)(t) = ryf^[0,x(^)(t)]= E V.-\*)<x(-'W}V''^\t)<..}- 

Thus Q^^\t) is the total number of customers who have arrived to the 
system and have not reneged by t and whose potential waiting times at t 
are less than or equal to X^^H*)- If arrange those customers in increasing 
order of their potential waiting times at t, then for i = 1,2, ... ,Q^^\t), 

(^p^t ')~^(i) is exactly the potential waiting time at t of the ith customer 
from the back of the queue. 

Suppose that {x^^\t-) - x'^^\t)){K^^\t) - i^W(t-)) = 0. This im- 
plies that either x^^\i-) = X^^HO holds or both x^^H*-) > X^^HO and 
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K^^\t) = K^^\t—) hold. The latter condition indicates that the head-of- 
the-line customer right before time t reneged at time t. In this case, the 
right-hand side of (5.16) admits the alternative representation 

h{{F^^ r\y))dy. 

On the other hand, suppose that {x^^^ (t-) - x^^^ {t)){K^^'^ (t) - K^^) (*-))> 
0. In this case, the head-of-the-line customer right before time t departs for 
service at time t and this customer is counted in the right-hand side of 
(5.16) but not in Q'^^\t). Since E^^\t) - E^'^\t-) < 1, there is exactly one 
such customer, that is, K^^\t) — K^^\t—) = 1. Hence the right-hand side 
of (5.16) can be rewritten as 



/ 

Jo 



h{{F^^ )-\y))dy. 



□ 

As an immediate consequence of (5.8), Lemma 5.4, and Proposition 5.5, 
e obtai 
of 

t G [0,cx)), 



we obtain the following alternative representation for the compensator ^^^j ^ 



where l^^^ is given by (5.15). 

6. Tightness of pre-limit sequence. The main objective of this section 
is to show that, under suitable assumptions, the sequence of scaled state 
processes {(X^^^ z7^^-*, rj^^-*)} and the sequences of auxiliary processes are 
tight. Specifically, from (2.23) and (5.4) it is clear that for every t, the linear 

functionals d':^^ {t):ip>-7- d\^^ (t) and ^4^,^^ {t):ipi-^ a[^^ (t) are finite Radon 
measures on [0,H^) x M_|_. Likewise, from (2.24) and the fact that (5.4) holds 
with i^, /i^, respectively, replaced by T],h'' by property (2) of Proposition 5.1, 



it follows that the linear functionals S^^^ {t):Tp "S*^^ {i) and A^^'^ [t) : ijj 

'A[^)i{t) define finite Radon measures on [0,iJ'') x R+. Thus 0.^\t):te 

[0,oo)} and 0^y\t) -.t [0,oo)} can be viewed asMpil^^H'') x R+)-valued 

cadlag processes, and {S^^\t) -.t S [0, oo)} and {A^^\t) :t G [0,oo)} can be 
viewed as Mf{[0, H"^) x M+)-valued cadlag processes. Now, for N G'N, let 

^ (XW(0),EW,X(^),i?W,I7(^), 
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Then each F(^) is a 3^-valued process, where y is the space 

X (^7V1f-([0,//'-)R+)[0,Oo))^ 

equipped with the product metric. Clearly, 3^ is a Polish space. Now we state 
the main result of this section. 

Theorem 6.1. Suppose Assumption 3.1 is satisfied. Then the sequence 
|y(^)| defined in (6.1) is relatively compact in the Polish space y, and is 
therefore tight. 

The relative compactness of {Y^^^} follows from Assumption 3.1 and 
Lemmas 6.3, 6.4, 6.6 and 6.7 below. Since 3^ is a Polish space, tightness is 
then a direct consequence of Prohorov's theorem. 

We start by recalling Kurtz's criteria (see Theorem 3.8.6 of [6] for details) 
for the relative compactness of a sequence {F^^^} of processes in 'D^j^ [0, oo). 

Proposition 6.2 (Kurtz's criteria). The sequence of processes 
is relatively compact if and only if the following two properties hold: 

Kl. For every rational t>Q, 

lim supP(^(^)(t) >R) = Q. 

R—^oo j\i 

K2. For each t > 0, there exists /? > such that 

(6.2) lim supE[|z(^) (t + S)- Z^"^ {t) f] = 0. 

(S-5>0 TV 

Lemma 6.3. Suppose Assumption 3.1 holds. Then the sequences 
{(1,I7(^))}, {(l,rj(^))}, the sequences 
every if> € Cb([0, H'') x IR+) and the sequences {S^^^}, {A^^^}, for every ip G 
Cb{[0,H^) X M_|_), are relatively compact. 

Proof. Fix Tg (0,oo). It follows from Proposition 5.1(1), (2.23) and 
(3.5) that for ipeCbi[0,H') x M+), 

supE[:4W(r)] = supE[m^)(r)] < ||(^|UsupE[XW(0) +EW(r)] < oo. 

N ' N N 

Similarly, by Proposition 5.1(2), (2.24) and (3.5), we have for every ^ G Cb{[0, 
xM+), 

supEpJf;)(T)] =supE[5j;^)(r)] < ||V'||ooSupE[X('^)(0) +EW(r)] < oo, 

N ' N N 
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which verifies condition Kl for Z = J^^} ,D')^\ip G C{,([0, H^) x IR_|.) and Z = 
^^}] ' ^^^^ ) V' S Cfe ( [0 , W ) X IR+ ) . The same argument that was used to prove 
Lemma 5.8(2) in [14] can then be used to show that (6.2) is also satisfied 
by the same collection of Z (see Remark 5.2). The fact that i?^^-* and its 
increments are dominated, respectively, by S^^^ and its increments shows 
that the sequence {-R^^^} also satisfies conditions Kl and K2, and is thus 

relatively compact. Since 

jj{N) ^ j^{N) g(N) ^ g{N)^ follows that the 

sequences {D^^^} and {S^^-*} are also relatively compact. By Assumption 
3.1, the sequences {E^^^} and {X^^\0)} are relatively compact. 

Since for every t > 0, (1,I7|^^) < xW(t) < XW(0) + B^)(t) by (2.30) 

and (2.12), it follows from Markov's inequality that {1,17[^^) and X'^^'' sat- 
isfy Kl of Proposition 6.2. In addition, (2.12) also shows that 

\xW{t)-x^^\s)\ < |E(^)(t) -E(^)(s)i + i;D(^)(t) -;d(^)(s)| 

and by (2.30) and the Lipschitz continuity of the function x i— > [1 — j;]^ with 
Lipschitz constant 1, we have 

|(l,I7S^V(l,^f^)l = |[l-^^'^^W]^-[l-^^'^^(s)]+j<|^(^)(t)-XW(5)| 

When combined with the properties of E^^\ D^^^ and R^^^ established 
above, this shows that {X^^^} and {{1,T'^^^)} satisfy K2 of Proposition 6.2 
and, are relatively compact. In turn, by (2.16), the relative compactness of 
and {(1,I7(^))} implies that of {K^^)}. Moreover, due to (2.13), for 
every s,t £ [0, oo), we have that 

(6.3) - < |EW(t) -EW(s)| + \S(^\t)-S^^\s)\, 

(6.4) (!,#))< (l,fjr^)+E(^)(t). 

Thus (1, r/(^)) is also relatively compact, and the proof is complete. □ 

Lemma 6.4. Suppose Assumption 3.1 holds. For every /€C^(M+), the 
sequences {{f,T'^^'')} and {{f,r]^'^^)} of Vt^[Q,oo) -valued random variables 
are relatively compact. 

Proof. Fix t E [0,oo). By (2.27) and (2.28), for every / G CcniR+)> we 
have 

{f,vT^) - = /V',^)) ds-D^Pit) + /(O)KW(t) 

and 

udP) - {fMP) = ds - sf\t) + fm^\t). 
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Since {Dj^^}, {K^^^}, {S'j^^} and {E^^^} are relatively compact due to 
Lemma 6.3 and property 1 of Assumption 3.1, it suffices to show that the 
sequences ^^{f' jui^^) ds} and {/q ds} are tight. It follows from (6.4) 
that for 6e (0,1), 



t+s 



rt+S 

{f',fjf^)ds <\\f'\\ooj^ \{l,vf^)\ds 

<\\f\U{{l,4''^)+E^''\t + l)). 



Hence, we have 

i-t+5 

.5) e" ' 



<||/'||oo5supE[(l,4^))+i?(^)(t + l)]. 

N 

For each t € [0,oo), by (2.3) and Assumption 3.1, it follows that 
(6.6) supE[(l,f?l^))] < supE[(l,4^)) + E^^\t)] < oo. 

N N 

Therefore, taking the limit, as 6^0, in (6.5) and using the last inequality 
in (6.6), we have 

- ft+S 

limsupE / {f',f]i^^)ds 

Similarly, since (l,!^^^'') < 1 for every s € [0,oo) and N £N, 

rt+S 



0. 



lim sup E 

<5^0 AT 



{fMI'^)ds 

Moreover, by (6.6), we also have, for every t G [0,oo 



<lim||/'|U<5 = 0. 

(5— >0 



supE 

N 



{f',fif^)ds 
Similarly, we have 



< ||/'|UtsupE[(l,7?(^)) +ii;(^)(t)] < oo. 



N 



supE 

N 



\f'M'''^)ds 



<supE 

N 



'\{f'M''^)\ds 



< ||/'||oot<00. 



This implies that {/o(/';??i^^) c^s} and ^^{f' ,vi^^) ds} both satisfy crite- 
ria Kl and K2 of Proposition 6.2 and hence are relatively compact. This 
completes the proof of the lemma. □ 

Next, we show that {V^^^} and {fj^^^} are tight, and hence are relatively 
compact with respect to the topology on ^^^^^[0,//") [Oi ^) '^Mf[o,H'') [Oi cxd), 
respectively. Since, as mentioned in Section 1.3.1, A4f[0, H^) and A4f[0, H'^), 
equipped with the topology of weak convergence, are Polish spaces, we can 
apply Jakubowski's criteria to establish the tightness of {!7^^-*} and {77^^^}. 
For convenience, we recall Jakubowski's criteria. 
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Proposition 6.5 (Jakubowski). A sequence {vf^^^} of Vj^^^q h-^[0,oo)- 
valued random elements defined on {Q,J^,¥) is tight if and only if the fol- 
lowing two conditions hold: 

Jl. For each T > and < 5 <1, there are compact subsets Ct,s ofMpi^, H) 
such that 

liminf P(I7J^) G Cts for all t G [0,r]) >l-5. 

J2. There exists a family ¥ of real continuous functions F on Mp [0, H) that 
separates points in M.p\fi,H) and is closed under addition, and {vf^^^} 
is ¥-weakly tight, that is, for every F G F, the sequence {F{7f^^^),s G 
[0,cx))} is tight in ^^[O,^). 

Lemma 6.6. Suppose Assumption 3.1 holds. The sequences and 
|7j{^)} are relatively compact. 

Proof. By Remark 5.11 of [14] and Lemma 6.4, it follows that {l/^^)} 
and {r/(^^} satisfy Jakubowski's J2 criterion. Therefore, it suffices to show 
that they also satisfy Jakubowski's Jl criterion. By (2) and (3) of Assump- 
tion 3.1, for almost every w G O, snY>jqV^^\ijj)[G, H^) < oo. By Lemma A 7.5 
of [12], for every e > 0, there exists A;(a;, e) < oo such that sup^'pl^\Lo){k{uj, e), 
H'^) < £. The argument for tightness of {V^^^} (in the absence of reneging) 
presented in Lemma 5.12 of [14] can be directly applied to show that {z7(^)} 
satisfies Jakubowski's Jl criterion, and hence {I7(^)} is tight in the pres- 
ence of reneging as well. Similarly, due to (2) and (4) of Assumption 3.1, 

for almost every cj G sup^ 77Q^^(a;)[0, i^'') < oo. Once again, by Lemma 
A 7.5 of [12], we infer that for every e > 0, there exists l{oJ,£) < oo such 

that sup j^r]ll^\uj) {I {to, e), H^) < e. Since {(l,rj(^))} is tight by Lemma 6.4, 
the argument for tightness of {U^^^} presented in Lemma 5.12 of [14] can 
also be adapted to show that the sequence {t]^^)} satisfies Jakubowski's Jl 
criterion, and is therefore tight. We omit the details. □ 

We end this section by establishing the relative compactness of the measure- 
valued processes associated with the cumulative departure and reneging 
functionals and their compensators. 

Lemma 6.7. Suppose Assumption 3.1 holds. Then the sequences 
and {A^^^} are relatively compact in I^XF([o,-f^=)xR+)[0) co). Similarly, the 
sequences {5.^^"*} and {A^:^^} are relatively compact 2^Aij,([o,_ff'-)xR+)[0) co)- 

Proof. This can be proved by combining Lemma 6.3 and Proposition 
5.1 with the argument that was used in Lemma 5.13 of [14] to establish the 
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tightness of the sequences {Q(^)} and {A(^)} therein. Since the adaptation 
of the argument in [14] is straightforward, we omit the details. □ 

7. Strong law of large numbers limits. 

7.1. Characterization of subsequential limits. The focus of this section is 
the following theorem which, in particular, establishes existence of a solution 
to the fluid equations. 

Theorem 7.1. Suppose that Assumptions 3.1-3.3 hold. Let {X,V,r]) be 
the limit of any subsequence of {X^'^^ }. Then [X^v^rf) solves the 

fluid equations. 

The rest of the section is devoted to the proof of this theorem. Let 
(£',X(0), VQ^rjo) be the 5o-valued random variable that satisfies Assump- 
tion 3.1, and let {y^^^jArgpj be the sequence of processes defined in (6.1). 
Then, by Assumption 3.1, Theorem 6.1 and the limits M^^^ = D^^^ — 

A^^^) ^ and M^^^ = 5^^^ - A^!^^^ established in Proposition 5.1, there 
exist processes X G 'Dfi_^_[0,(X)), R € V^^[0,oo),V G D^v^^fcH") [0) oo), r] G 
^A4f[0,H'-)[0, oo), G I'a4f([0,//»)xK+)[0, oo), Z?. G ^A4f([0,//»)xM+)[0,Oo), 

A-,7j eVMp([Q,H-)xR+)[0,oo), S. eVMp{[o,Hr)xR+)[0,oo) such that F^^) con- 
verges weakly (along a suitable subsequence) to 

F= (Z(0),;E,X,i?,I7o,I7,77o,r/, A,^, A,^, A,;,, A,;,) G 3^. 

Denoting this subsequence again by Y^^^ and invoking the Skorokhod rep- 
resentation theorem, with a slight abuse of notation, we can assume that, 
P a.s., y^'^) Y as N ^ oo. Without loss of generality, we may further 
assume that the above convergence holds everywhere. 

We now identify some properties of the limit that will be used to prove 
Theorem 7.1. From Proposition 5.1(1), it follows that, as N —?■ oo, {Y^^\ 
d':'^^) (F, A,^). Together with (2.12), this implies that 

(7.1) X = X{0) + E-Ax^^-R. 
Moreover, we claim that 

(7.2) A^,u= / {(ph',Vs)ds. 

Jo 

This corresponds to relation (5.48) established in Proposition 5.17 of [14] for 
the model without abandonments. However, essentially the same argument 
can be used here as well. Specifically, the proof of (5.48) in [14] relies on 
Lemmas 5.8(1) and 5.16 of [14], which continue to be valid in the presence 
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of abandonments due to Remarks 5.2 and 4.7. On substituting (7.2) into 
(7.1), we see that the fluid equation (3.15) is satisfied. 

Next, in Proposition 7.2, we estabhsh representation (3.14) for R given 
in the fluid equations. The proof of this result rehes on the alternative rep- 
resentation for the compensator A^^) ^ of R^^^ given in (5.17). 

Proposition 7.2. For every T e [0, oo), as N ^ oo, 



(7.3) E 



sup 

.tG[0,T] 



:4(^) (t) 







0. 



Moreover, almost surely, 

"t / rQ{s) 



(7.4) R{t) 



h'-{{F^^r\y))dy]ds, tG[0,oo 







The proof of Proposition 7.2 is given near the end of this section and relies 
on the following preliminary observations. Let R{t) be deflned by the right- 
hand side of (7.4) for t G [0, oo). We first show how (7.4) can be deduced 



(TV) 



R as N oo. Since R 
by Lemma 5.4, 



from (7.3). From (7.3), it follows that 

is continuous, = M^fJ, + ^ijfj, _^ and M^fj,^^ 

it follows that R^^^ =^ R. This implies, a.s., R = R, and thus the second 
statement of Proposition 7.2 follows from the first statement. 

The proof of (7.3) relies on Lemmas 7.3-7.6 below and the following 

observations. Using (5.17) and the elementary relation {F^" )~^{N-) = 



{F^" ) (•), simple algebraic manipulations show that 



h'-HF^^ )-Hy))dy]ds, 



(7.5) 

t € [0, cxd), 

where, as usual, 7*-^-* = l^^^ /N and l^^^ is given by (5.15). Next, observe 
that for ah t G [0,r] and L G [0,H''), 

(7.6) p^fj, Jt)-R{t)\< Cf^ {t,L) + cf\t,L) + C,{t,L), 
where c\^\t, L),i = 1,2, and Cs{t,L) are defined, for t G [0,oo), by 



(7.7) cf\t,L) 



(Q('^)(s)+l(^'(s))AF'' 



(JV) 



-(iV) , 



h'HF^^ r'{y))dy]ds 



Q(s)AF'^s(L) 



hJ\{F'^^)-\y))dy]ds 



FLUID LIMITS OF MANY-SERVERS QUEUES WITH RENEGING 



43 



(7.8) cf)(t,L) = 
and 



/_ )-\y))dy\ds 

VJ(Q('V)(s)+z(^V)(s))AF^^i (L) / 



(7.9) C3(t,L)= /■Y£^^'^ /i^((F^o-'(y))dyV«- 

As a precursor to the proof of (7.3) of Proposition 7.2, we first establish 
some path properties of the limiting queue measure rj in Lemma7.3 and 
some estimates in Lemma 7.4. These two preliminary results will be used in 

Lemma 7.5 to show that for any L G [0,i/'''), lim7v-i>oo sup^gfg.T] |C'i^^(t,i)| = 
in the case when is continuous. Next, Lemma 7.6 extends this to include 
general that is locally integrable in [0,H^). All these results are then 
combined to prove Proposition 7.2. 

Lemma 7.3. For every L € [0,H'^), fjf. is continuous at L for almost 
every t > 0. Moreover, for t S (0, oo) and L € [0, H"^), if r/(({L}) > 0, then 
rJ^(L, L + e) > for all sufficiently small e. 

Proof. It was shown in Corollary 4.2 that {r],E) satisfies (3.20) for ev- 
ery bounded Borel measurable function /. For every L S [0, H'^), substituting 
f = 1l in (4.2), we obtain 



mm) 

(7.10) 



f , A-GHx^t) , , , 

+ l-G-(x) 

+ / ^L}{t-s\\-G\t-s))dE{s). 



It is easy to see that the right-hand side of the above display is zero except 
when ?7o({L - i}) > if t < L or when E{t - L) - E{{t - L)-) > if t > L. 
Since the jump times of both t^q and E are at most countable, (7.10) shows 
that r/^ is continuous at L for almost every t > 0. 

Next, suppose fJj({L}) > 0. Then by (7.10), at least one of the following 
two inequalities must hold: 

r , A-GHx^t) , , , 

(7.11) / HL}{x + t) ^ ' r)^{dx)>Q 

J[0,H^) i — (-X [X) 

or 

(7.12) [ l{L}it-s)il-G'^{t-s))dE{s)>0. 
J[o,t] 
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If (7.11) holds, then it must be that L-t G [0,ifO, (1 - G'~(L))/(1 - G'"(L - 
t)) > and r/o({L — t}) > 0. By Assumption 3.2 and the continuity of (1 — 
G^{- +t))/(l - C(-)), it then follows that for ah sufficient smah e>0, 

(7.13) / l(^L,L+e){x + t)^^^^-^j^Vo{dx)>0. 

J[0,H^) i — Lr [X) 

Substituting / = l(^L,L+e) i'^to (3.20) in Corollary 4.2 shows that r]^{L,L + £) 
is greater than or equal to the left-hand side of (7.13), and so the lemma is 
established in this case. On the other hand, suppose (7.12) holds. In this case, 
t - L > 0, 1 - G'it - L) > and E{t - L)-E{{t -L)-)> 0. By Assumption 
3.2 and the continuity of 1 — G^(i — •), for all sufficiently small e > 0, 1 — 
G''{t--) is strictly positive on (L,L + e) and E{{t- L)-) -E{t- L - e) > 0. 
Another application of (3.20) of Corollary 4.2, with / = shows that 

%(L, L + e)> f \L,L+e){t -s){l- G^{t - s)) dE{s) > 0, 
Jo 

and the proof of the lemma is complete. □ 

Lemma 7.4. Let T S [0, oo) and L € [0,-/^). The following estimates 
hold: 

1. For m G and every £ G L^^^[0, H'') with support in [0,m] , there 

exists L{m,T) < oo such that 



(7.14) 



T 



{I, rj,) ds 



<L{m,T) I \e{x)\dx. 



2. Suppose h is a measurable function such that = sup2.g[o,L] 1^(2^)1 < oo. 
Then, P-a.s., 

(7.15) sup sup / h{x)r]i^\dx)<C'lsup{{l,r]l^^)+E^^\T))<oo. 

N s£[0,T]Jo N 



Proof. It was established in Lemma 5.16 of [14] that inequality (7.14) 
holds with r/ replaced by the fluid age measure 17 associated with a many- 
server queue without abandonments. The proof follows directly from Propo- 
sition 4.15 and the estimate (5.46) of [14]. Since the dynamic equations (2.28) 
and (3.20) for t]*-^-* and fj, respectively, are exactly analogous to the dynamic 
equations for z^^^^ and V. Estimate (5.46) of [14] can be shown to hold for r] 
using the same argument as in [14]. When combined with Proposition 4.15 
of [14], this shows that (7.14) holds. Estimate (7.15) follows directly from 
(2.13) and Assumption 3.1. □ 
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Lemma 7.5. For T > and all hut countably many L € [0,^^"), given 
any continuous function h on [0,oo), as N ^ oo, for every realization, 



(7.16) 



sup 

tG[o,r] 



( jV") 

(Q(iV)(s)+l(iV)(s))AF''^ (L) 



h{{F 



ds 



Q(s)AF'^s(L) 



h{iF'^^)-\y))dy]ds 



Proof. Fix w G il. To ease the notation, we shall suppress uj from the 
notation. From the convergence of r?(^) to 77 and Q(^) to Q, it follows that, 
as — > 00, r/i^'' ^ rjg and Q^^-'(s) — )■ for almost every s > 0. Also, 
by Lemma 7.3, r/^ is continuous at L for almost every s > 0. Let s > 

be a time at which fji^'' ^ rj^ and Q^^\s) — > Q{s) as N —> 00 and fj^ is 

_{N) _ 

continuous at L. Then, as 00, F"^"^ (x) — t- F^'>{x) for x = L and all but 
a countable number of x € [0,H'''). Therefore, by Theorem 13.6.3 of [23], 

we have (F^^"^')"^ ^ (F^^)-^ on [0, (i?^-)) in the Mi topology. For 
s € [0, r], we now show that, as — )• 00, 



(N) 

(Q(^)(s)+l('^'(s))A-F''« (L) 



(7.17) 



h{{F^^ r\y))dy 



/ 



Q(s)AF''s(L) 



/i((F^O"'(y))^y- 



From the inequality \ < 1/N, we immediately see that 



(7.18) (g(^)(s)+7^'"^(s)) AF"^" '(L)^Q(s) AF''-(L) 



AN) 



.tt(JV) 



as iV- 



00. 



We now consider the following two cases: 

Case 1. Q(s) AF^-(L) < F^=(/?^-). In this case, due to (7.18), for all 

sufficiently large N, (Q(^)(s) + 7(^)(s)) A F^^"^' (L) < F^''(iF'-). For each 
n E N, by Theorem 11.5.1 of [23] and the continuity of h, we obtain for each 
t<F^s(^H'^-), 



lim sup 



h{{F 



\y))dy 



h{{F^^r\y))dy 



0. 



By the case assumption, this implies, in particular, that 



lim 



Q{s)AF^s(L) 

h{{F^^ )-\y))dy- 



h{{F^^)-\y))dy 



0. 
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On the other hand, (7.18) and the continuity of h show that 

Together, the last two assertions imply (7.17). 

Case 2. Q{s) A F^^{L) = F^-(iJ'"-). We first claim that in this case 

(7.19) Q{s) = F^^{L) = F^^{H''-). 

Indeed, F^'>{L) < F^'>{H^' — ) because F^" is nondecreasing and L < i^*", 
while Q{s) < r]g[0, H'') = F"^^ {H^'—) by (3.13). On the other hand, the reverse 
inequalities Q{s) > F^-{H''-) and F^-(L) > F^-{H^-) hold by the case as- 
sumption, and so the claim follows. Now, define L = (F'^'>)~^(F'^'>{H^—)). 
Then 1= (F^-)-i(F^»(L)) by (7.19). Hence, I < L and 

(7.20) F^^(L) = F^^{L) = F^^{H''-). 

This implies rjg{L,H^') = 0, and from the second assertion of Lemma 7.3, it 
follows that 

(7.21) U{L}) = 0. 

The change of variables formula and (7.20) then yield 

fQ(s)AF^s(L) 



/ 

Jo 



h{{F'^^)-\y))dy= / h{x)r),{dx) 

(7.22) 

h{x)r]g{dx). 

lo,L] 

Also, by Proposition 5.5 and another application of the change of variables 
formula, we have 

h{{F^^ )-\y))dy 

(7.23) "° 

= / l[0,L](x)/l(x)7jf)(dx). 

Expanding the term on the right-hand side of (7.23) and using the inequality 
L < L, we obtain 

llo,L]ix)h{x)r](f\dx) 



(7.24) 



l[o,L]{x)h{x)fjf\dx) 

[0,L] 
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- / l[o,i](x)/i(x)r?f 

J{x(^Hs-)AL,L] 

By (7.22) and (7.23), the left-hand side and the first term on the right- 
hand side of (7.24), respectively, equal the left-hand side and right-hand 
side of (7.17). Therefore, to prove (7.17) it suffices to show that the second 
and the third terms on the right-hand side of (7.24) converge to zero, as 
N ^ oo. Recall the constant C'l defined in Lemma 7.4. Note that < oo 
since h is continuous. Therefore, the second term on the right-hand side 
of (7.24) is bounded above by C'lr]f\x^^Ks-) AL,x^^Ks-)]. By (7.21), 
Portmanteau's theorem and (7.20), it follows that 

lim fjf\x^^Hs-)/\L,x^^\s-)]< lim fjf\L,H')=r][L,H')=0. 

On the other hand, the absolute value of the third term on the right-hand 
side of (7.24) is bounded above by C'lr][!^\x^^Hs—) AL,L]. We now argue 
by contradiction to show that liminfAr_!.ooX*'^'*(*~) ^ ^ ^^'^^ consequently, 
that r]i^\x^'^\s—) A L,L] converges to zero as N ^ oo. Indeed, suppose 
this assertion were false. Then there must exist a subsequence {A^^fcl^gp} such 
that limfc_).oo X^'^'°H'5~) = L — 5 for some 5 > 0. Hence, for k large enough, 
x(^>'\s-)<L-5/2. By Lemma A.2, we have x''^''\s-) > x^^''\s). Hence 

r/i^'=^[0,L - (5/2] >Q(^'=Hs) by (2.6). Sending k ^ oo and using the con- 
vergence rji^''^ ^Vsi f^ct that [0, L — 5/2] is closed and Portmanteau's 
theorem, we obtain rjg[0,L — 6/2] > Q{s). This contradicts the definition of 
L, and hence completes the proof of (7.17). 

Finally, we deduce (7.16) from (7.17) using the bounded convergence the- 
orem, whose application is justified by the bounds (7.22), (7.23) and the 
estimate (7.15). □ 

We now generalize Lemma 7.5 to allow for a general locally integrable 
(not necessarily continuous) function /i'' on [0,H^'). 

Lemma 7.6. Let L < H'' , and letc['^\t,L),te [0,oo),iV€N be defined 
as in (7.7). Then for every T G [0, oo), almost surely for L < H'' , 

(7.25) lim sup c[^\t,L) = 0. 

Proof. Fix L < . Since lies in Cl^J^O^H"^) and is nonnegative, 
there exists a sequence of nonnegative continuous functions {/iJi}n>i on 
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[0, H'') such that Jq — W^{x)\ da; — t- as n — )> oo and /ij^ has common 

compact support m [Ojif). For each n E N, (7.25) holds with /ij^ in place 
of due to Lemma 7.5. Let l"^ = — for each n > 1. Then, in order 
to prove (7.25), it clearly suffices to show that the following two limits hold: 
almost everywhere. 



(7.26) hm sup / / /;((F^= )-\y)) dy] ds = Q 

N^oo N Jo \Jo J 

and 

(7.27) ^lirn^y^ ^ /;((F^O"Hy))^yJrf^ = o. 

We first consider (7.26). By Proposition 5.5, applied to h = l'^, and the 
same scaling argument that was used to obtain (7.5), for every iV, n G N, 

(N) 

rT / AQ<^^){s)+j(^){s))AFnl >(L) \ 

I [I mF"^' r\y))dyjds 

i:{x)r]f\dx)) ds< n [ lUx)rjf\dx)) ds. 



lO \J[0,x(^)(«-)Ai] / -'0 \J[0,L] 

By (2.2) and the representation of rj^^^ in (2.3), we have 

V;,{x)r)i''\dx)]ds 
'0 \J[0,L] J 

rT 

ds 



f 

Jo 



7(iV) 

'0 

£;{JV){T) 



{-C<~'<L} 



<sup((i,7?(^)) + £;W(r)) / z;(x)dx. 

Af JO 

Since sup^((l, 77q^^) + E'^^^t)) < oo almost surely, due to Assumption 3.1, 
and /i^ converges in £/„JO,iJO to /^^ we obtain (7.26). On the other hand, 
observe that, by (7.14) of Lemma 7.4 applied to I = V^, 

i:{{F'^^)-\y))dy]ds< / Ux)Udx)]ds 



\J[0,L] 

L 



<L{L,T) [ f„{x)dx. 
Jo 
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By the convergence of /i^ to in Cl^^[0,H'^), the last term on the right- 
hand side of the above display converges to 0, as n — > oo, and (7.27) follows. 
□ 



Proof of Proposition 7.2. Given the discussion prior to Lemma 7.3 
and, in particular, (7.6), to complete the proof of the proposition, it only 
remains to show that 



(7.28) 

and 
(7.29) 



lim lim sup E 



' sup cf)(t,L)' 

■te[o,T] 



0, 



1,2, 



lim E[C3{T,L)] = 0. 

L — ^H^ 



For the case i = 1 in (7.28), this follows from Lemma 7.6 and the dominated 
convergence theorem, whose application is justified because, by (7.22), (7.23) 
and the fact that L < L, 



E 



sup cf\t,V) 

■te[o,T] 



<E 









[0,L] 



h'{x)rif\dx) ds 



+ E 



T 



[0,L] 



{x)r]g{dx) I ds 



which is bounded uniformly in N by (7.15) and Assumption 3.1. 

Now, by Remark 5.2, an application of Lemma 5.8(1) of [14] (with i/, 
and i^*, resp., replaced by r], N' and i/^, resp.), shows that 



(7.30) 



lim supE 



h''{x)rif\dx)]ds 



0. 



On the other hand, the definition of C'^\t, L) in (7.8), when combined 
with Proposition 5.5 and (7.23), shows that 



supE[C^^^(r,L)] <supE 

N N 



h'{x)r]f\dx)) ds 



Taking the limit, as L ^ H^' , and invoking (7.30), it follows that (7.28) holds 
for i = 2. Finally, to show (7.29), we see that, by the definition of C3{T,L) 
in (7.9) and the change of variables formula. 



E[C3(r,L)]=E 



h^\{F'^^)-\y))dy]ds 



< 



Q{s) 

\JQ{s)AF'^s{L) 

h^{x)rig{dx) \ ds. 



\J[L,H^) 
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If h"^ is bounded, then (7.29) holds by simply applying the bounded conver- 
gence theorem on the right-hand side of the equality in the above display. 
On the other hand, suppose h"^ is lower-semicontinuous on [U\H''') for some 
U' < . Then, by Theorem A. 3. 12 of [5] and the fact that P a.s., rji^-* ^rj^, 
as N ^ oo, for a.e. s € [0,r], this implies that for any such s and L > U , 



{x)ri g{dx) I ds < liminf 



h'{x)rii^\dx)]ds 



Integrating both sides over s G [0, T] and taking expectations, an application 
of Fatou's lemma yields 



E[C3(r,L)] < liminf E 



h'\x)r]f\dx)]ds 



Taking the limit as L — )• , an application of (7.30) shows that (7.29) holds. 
□ 



We now prove the main limit result. 

Proof of Theorem 7.1. Fix t e [0, oo) such that 17^^^-' ^ Vt, rff^ ^ 7]^, 

(t) ^E{t), X(^) (t) ^ Xit) , {t)^R{t), A^^) (t) 4 A,, (t) , D^""^ (t) 

A,^(i), A^,^^(t) 4 A,^(t), S^^\t) ^A.^r,it) as iV^ oo. Since F(^) ^ F 
a.s., this occurs for t outside a countable set. By (7.2), this implies that as 

iV^ oo, 

:D(f )(t) ^ \,,{t) = [\ip{;s)h'{;s),V,) ds, 

(7.31) 







<peCbi[0,H')xR+). 
An analogous argument also implies that, as — )■ oo, 

(7.32) ^° 

V'€C6([0,i70 xK+)- 

In particular, when ip = ip = 1, the above two displays imply that (3.8) 
holds. Also, we immediately obtain that, as A — > oo, {l,v\^'^) 
and (l,r/S^'') ^ (1,/?^). When combining with (2.15), (2.30), (2.14), (2.20), 
(2.12), (2.6), (7.4), this implies that all the equations in Definition 3.3 are 
satisfied at time t except (3.9) and (3.11). 

It only remains to show that (3.9) and (3.11) are also satisfied at time 
t. We shall just prove (3.11). The same argument will also show that (3.9) 
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holds. Dividing (2.28) by A^, we have 



J[0,t] 

Since r]'^^ % by Assumption 3.1(4), rji^-* rj^ for a.e. s G [0, t], r][^'^ ^ 7]^ 
by our choice of t and ip{-,t) and ^a:(-, s) -|-'(/'s(-, s), s G [0, t], are bounded and 
continuous, as — )• oo, we have 

(^(•,t),7?f))^(^(.,t),r/,) and (^(•, 0),^^)) ^ (^(•, 0), 7?o), 
and, by the bounded convergence theorem, 

(^x(-,s)+V's(-,s),r/i^-')ds^ / {ipxi-,s) +ipsi-, s),r]^)ds. 
JO 

On the other hand, using an integration-by-parts argument, the facts that 
E^^){0) = 0, E^^^ -^E,E is nondecr easing and ips{0,-) is bounded and 
continuous on [0,t], along with the bounded convergence theorem, we see 
that, as — 7> oo, 

^iO,s)dE^^\s)^ [ i;{0,s)dE{s). 

Combining the last four displays with (7.32), it follows that (3.11) holds. 
Then it follows that all fluid equations are satisfied for all but countably 
many t. By right-continuity (with respect to t) of each of the terms in all 
fluid equations, we conclude that all fluid equations are a.s. satisfied for 
all t G [0,oo). This completes the proof of the desired result that {X,V,rj) 
satisfies the fluid equations. □ 

7.2. Proof of Theorem 3.8. This section is devoted to the proof of Theo- 
rem 3.8. Recall t}^\.s) in (2.17) and its fluid scaled version defined in (3.3). 
Observe that the virtual waiting time defined in (2.18) can be rewritten in 
terms of the fluid-scaled quantities as 

(7.33) (t) = inf > : {t + s)- ^^'^ (t) + ^ {s) > g(^) (t)}. 

We first show that for each t G [0, cxo), T[^^ =^ Tt as — > oo, where Tt 
is defined in (3.26). Notice that a customer j who arrived into the system 
before time t and has not reneged by time t must have a potential waiting 
time Wj^^ (u) > u — t for all u > t sufficiently small. In addition, for that 
customer to have reneged from the queue (before entering service) in the 
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period [t, t + s], there must exist a time u € [t, t + s] such that the customer 
is stih in queue (i.e., has not yet entered service) or, equivalently, such that 

Wj'^\u) < x^^Hu—), the waiting time of the head-of-the-hne customer just 
prior to u, and the customer reneges, so that the slope of her potential 
waiting time changes from one to zero. Therefore, for each s G [0, cx)) , 7^'^^'' (s) 
can be alternatively expressed as 

71 (s) = X] ^ '^{dwl'^'>/dt{u-)>0,dw'^''^/dt{u+)=0} 

uCi[t,t+s] j^_£(N) 

Let 

' (s) = ^ X] ^{dw^.'^'>/dt{u-)>0,dw^.'^'>/dt{u+)=0}'^{w'^P(u)<x('^Hu-)} 

and 

% = X/ X^ ^{dw':'^'>/dt{u-)>0,dw'-.'^'>/dt{u+)=0}'^{w':'^'>{u)<u-t}- 

It is easy to see that T^^^'^s) = T,^'''^'\s) - T}'''^'\s), %^^'^'\s) = + 
s) - (t) , 7;(^).2 (,) < (i + - (t) and T^''^'' {s + 5)- T^""^'^ {s) < 
S^^^ {t + s + 6) — S^^^ {t + s). Therefore, an application of Kurtz's criteria in 
Proposition 6.2 shows that the relative compactness of the fluid scaled ver- 
sions T'j^'''^ and 7~|^'*'^ of T^^^-*'^ and t}^^'"^ , respectively, follows from that 
of R^^^ and S'^^^ established in Lemma 6.3. By a straightforward adaption 
of the argument used in Proposition 7.2 to show the convergence of R^^'^ to 
i?, we can conclude that T^^^ =^Tt as N ^ oo. 

Recall the application of the Skorokhod representation theorem in Theo- 
rem 7.1 to assume, without loss of generality, that y(^) converges a.s. to Y. 

Here, we can also assume, in addition, that T'[^\s) -^Tt — 7> oo. 
Since Q is continuous at t and, by (7.2), A-^^i, = j^^{h^ ,Vs) ds is continuous 
by the integral representation, and Tt has continuous paths by definition, 
it follows that, almost surely, Q^^\t) — t- Q{t) and for each T € [0,oo), as 

sup |I^(^)(t-Fs) -]4i,j.(t-Fs)| ^0 and sup |rj^^(s) - Ttl ^ 0. 
se[o,r] ' se[o,T] 

From (7.33), it is easy to see that W^^\t) < (D^^'))-^D^^\t) + Q(^\t)) -t 
for each N. By the tightness result established in Theorem 6.1, we know that 
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D^^\t) + Q^^\t) is bounded uniformly in N, and due to Lemma 4.10 of [21] 
and the assumption that A^^i, is uniformly strictly increasing, we also know 
that {D^^^)~^ — > {Ai^^)~^ uniformly on compact sets, as N ^ oo. Hence, 
W^^\t) is bounded uniformly in N. Therefore, there exists a subsequence, 
W^^"\t), n G N, that converges to a limit in [0,oo), which we denote by 

W*. From (7.33) and the right-continuity of I^(^),Q(^) and t[^\ we then 

have ;d(^") {t + W^^"\t)) - D^^-\t) + t[^"^ {W^^"^ (t)) > Q^^-\t) . Sending 
n ^ oo, we obtain 

(7.34) M^,{t + W*)- M^,{t) + Tt{W*) > Q{t). 

Together with (3.27), this shows that W{t) < W* . Now, suppose that W{t) < 
W*, and fix w such that W{t) <w< W* . Since Ai^i, is uniformly strictly 
increasing and Tt is nondecr easing, the inequality W{t) < w implies that 
Ai^u(t + w) — Ai^^{t) + Tt{w) > Q(t). Therefore, for sufficiently large N, we 

have D(^\t + w)- D^^^t) + Ti^\w) > QW(t) and hence W^^^t) < w. 
In turn, this implies that W^^"^ (t) < w for sufficiently large n G N. Sending 
n — )• oo and using the convergence of W^^"-\t) to W* , we then obtain W* < 
w. This contradicts the choice of w. Hence W{t) = W* , and this proves the 
desired result. 

APPENDIX A: EXPLICIT CONSTRUCTION OF THE STATE 

PROCESSES 

In this section, we construct all state processes and auxiliary processes de- 
scribed in Section 2.2 from the initial data {e'f'^ , X(^) {fS),wf ^ (0) , af^ (0), j = 

-4^) + l,...,0}, {4^^(t),tG[0,c5o)}, {7;„jGZ} and {rj,jGZ}. 

Fix and, for simplicity, we omit the dependence on in notation. 
Let -E(O) =0. The process E on [0, oo) can be obtained from aE using the 
relation (2.1). Let £ = 0, tq = 0, and let R{n) = D{ti>) = K{ti) = 0, 

(A.i) Q{n) = [x{n)-N]^, 

and for j > E{t£), let Wj{T() = aj{Ti) = 0. Now, for t G [rg, oo), define 
(A.2) x\t) = mf{x >0:r,r, [0, x] > Q{Te)} + t-n. 

Also, for j = —£q + 1, . . . , 0, . . . , E{t() and t G [r^, oo), let 
w]{t) = {wjin) + t-Te)A rj, 

Q^(^) ^ I 0' if Wj{Ti) = rj or Wj{Te) < X^{n), 

^ \{aj{Ti)+t-Ti) Avj, if x\n) <Wj{n) <rj, 

E(ti) 

111= Sw,{t)'^{dWj/dt{t+)>0}, 
j=-€o+l 



54 



W. KANG AND K. RAMANAN 




{wj{s)<x^{s-),dwj /dt(s-)>0,dwj /dt(s+)=0}^ 



j=-£o+ls£lO,t] 




j=-So+ls£[0,t] 

Next, define 

Ti+i = inf{i > : {D\t) - D{Ti)) A {R^{t) - Rin)) A {E{t) - E{n)) > 0}. 

For t G [Ti,Te+i), let Y{t) = Y^{t) for Y = Wj,aj,j € -So + l,...,^(r^), 
R, D, r], V and x and set y(t) = Yije) for y = X, Q, Wj,aj,j > E{ti). More- 
over, define 



and, if £'(rf+i) > E{ti), then £'(rf+i) = i?(rf) + 1, and then let Wj{T£j^i) = 
for j G {-E'(rf) + 1, . . . , £'(rf+i)}. In this case, (5(t£+i) and can be 

defined via equations (A.l) and (A. 2), but with H. replaced by £ + 1, and the 
procedure can be reiterated. Now, max{£:r£ < t\ is bounded by £'o + E{t), 
and is therefore a.s. finite. Therefore, — )■ oo as £ — > oo, and so the above 
procedure constructs the above processes on [0, oo). K and S can then be 
defined, respectively, via equations (2.14) and (2.13). 
For each j > —£q^\ by the construction, we have 



where Cj = inf {t > : E(t) = j}. Hence the process Wj defined above is indeed 
the potential waiting time process of customer j. It is also not to hard to 
see that the process aj defined above is the age process of customer j and 
satisfies (2.7). We next show that the process x constructed above satisfies 



(2.5). It is easy to see that x(0) = X°(0) by (A.2) with t = and ^ = 0. 
The x(0) satisfies (2.5) for t = 0. When t € [tq, n), Q{t) = Q{0), i]t = Vt and 
x(t) = x^{t). Then we have 

X\t) = mi{x > : 7]r, [0, x] > Q(to)} + t-To = mf{x > : r]t[0, x] > Q{t)}. 



X{n) + E{n+i) - E{n) - D{n+i) + D{n) 
-R{n+i) + R{n), 

r^i^^^ + {E{T,+,)-E{T,))5o, 



w 



'jit)= E Mri,n+i)ii)iwj{Ti) + t-Te) Arj 

Eii)>j 
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Hence x satisfies (2.5) on the interval [ro,ri). By the standard induction 
argument, we can see that x satisfies (2.5) for all t > 0. 
For each t > 0, by the construction, we have 

oo E{ti) 

{t)'^{dwj/dt{t+)>Q} 

1=0 i=-£o+i 

oo E{t) 

= ^hnn+i){t) ^ K,{t)^{dw,/dt{t+)>Q} 
1=0 j=-£o+l 

m 

= E ^Wj{t)'^{dwj/dt{t+)>0}- 
j=~So+l 

This shows that the r] constructed satisfies (2.3). A similar argument shows 
that the processes z^, D and R constructed satisfy (2.8), (2.9) and (2.11), 
respectively. Finally, K and S satisfy (2.14) and (2.13) by construction. 
Recall that, for t G [0, oo), is the cr-algebra generated by 

(^o,^(0),ai5(s),u;,(s),a,(s),jG{-fo + l,...,0}UN,sG [0,t]} 

and {Tt} is the associated completed, right-continuous filtration. 

Lemma A. 1. The processes Wj,aj,j > —£q + 1 and E,R,D,ri,i',x,X,Q, 
K,S are cadlag and {J-'t} -adapted. 

Proof. The cadlag property of those processes follows from the con- 
struction. Now we show that all the processes are {J^t}-adapted. Indeed, it 
follows immediately from (2.1), (2.3), (2.8), (2.9) and (2.10) that E,r],u,D 
and S are J^^-adapted. We next show that x is J^t-adapted. By equations 
(2.4) and (2.5) evaluated at time 0, it follows that x(0) is a function of X{0) 
and rjQ and hence J-Q-adapted. Now, let t > 0. For each i >0, by the in- 
duction argument, x^i^) is J-j-adapted, and T£ is an J^^-stopping time. Since 
Xt = xi if i G [Te,T£^i), X is J^t-adapted. Equations (2.11) and (2.12) show 
that R and X are J-^-adapted, and it follows from (2.4) and (2.14) that Q 
and K are J-^- adapted. □ 

The next lemma establishes some basic properties of x(0' the waiting 
time of the head-of-the-line customer at time t, defined in (2.5). 

Lemma A. 2. x piecewise linear with downward jumps that occur when 
the head-of-the-line customer either enters service (due to a departure from 
service) or reneges from the queue. Hence, x{i~) ^ x(0 /o*" every t G (0, oo). 
Moreover, for every t > 0, there exists et{oj) G (0,t) such that for all i G 
{t - et{uj),t), xit-) - X{i-) =t-i>0. 
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Proof. By the construction, Xt = xf if ^ ^ b'e,'Te+i)- Since is linear 
on [r^,T£_|_i), X is piecewise linear. Also x can only jump at r^+i, £>0. 
Based on the definition of r^+i, it is not hard to see that x can only have 
a downward jump at r^+i when the head-of-the-line customer either enters 
service [D^{t£^i) — D{t^) > 0] or reneges from the queue [i?^(T£+i) — R{Ti) > 
0]. Then we have x{t~) ^ x(*) for every t € (0,oo). The last statement of 
the lemma follows from the fact that x is cadlag and piecewise linear. □ 



APPENDIX B: STRONG MARKOV PROPERTY 

In this section we show that the state descriptor V^^^ = {of^^ , X^^^ , u^^^ , 

7]'^^^) is a strong Markov process with respect to the filtration {Tf^\t > 
0} defined in Section 2.2.4. To ease the notation, we shall suppress the 
superscript {N) from the notation. 

Let A^D [0, ' ) and A4d [0, if'^ ) be the subsets of A4f [0, i?" ) and A4f [0, > 
respectively, such that each measure in 7W£)[0,i7*) and Md[^-,H^ ) takes the 
form Ya=i ■ Define 

^ ' x<(l,^) + (l,^),(l,^)<iV /' 

where M+ is endowed with the Euclidean topology d, Z+ is endowed with 
the discrete topology p and Md[0, H^) and M.d[Oi H'^) are endowed with 
the weak topology, respectively. The space V is a closed subset of M+ x Z+ x 
^AF[0,H^) X AipiO, H"^) and is endowed with the usual product topology. 
Since M+ x Z+ x Mf[0,H'^) x Mf[0,H^) is a Polish space, then the closed 
subset V is also a Polish space. Now, denote 

V{t) = {aE(,t),X{t),ut,rit), t>0. 

It is obvious that y is a V-valued process adapted to the filtration { , t > 
0}, the natural filtration generated by V. 
For each y,z £V and t > 0, let 

(B.2) P^(y,z)=F{V{t) = z\V{0) = y). 

For any measurable function ip defined on V and t > 0, define the function 
Ptip on V as 

(B.3) PMy)=E{i,{VmV{0) = y], yeV. 



Lemma B.l. The state descriptor V is strong Markov with respect to 
{J't, t > 0}, and hence is strong Markov with respect to {J-Y ,t > 0}. More- 
over, {Pt,t>0} in (B.2) is the Markov semigroup of V . 
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Proof. To establish the strong Markov property, we shall identify V 
as a, so-called, piecewise deterministic Markov process (cf. [11]). From the 
explicit pathwise construction of V in Appendix A, it follows that V is 
a piecewise deterministic process with jump times {ti,T2, . . .}. Each jump 
time is either the arrival time of a new customers or the time of a service 
completion or the time to the end of a patience time. Note that, due to 
the nonidling condition, the time of entry into service of a customer must 
coincide with either the arrival time of that customer or the time of service 
completion of another customer. Let tq = 0. For each integer n > 0, let P„ = 
V{Tn)- Then {{Tn,Pn),n > 0} forms a marked point process. For each n > 0, 
V evolves in a deterministic fashion on [r„,r„_|_i). For each t>0 and y G V 
with y = (a, x, ^^^^ ^u,,T.j=i S^J and k<N, define 

(*) My)= [a + i,x^^^u,+t,^S;,^+t\■ 

\ i=i j=i / 



It is easy to see that 

4>t+s{y) = MMy))^ My) = y^ 

and the map 1 1— t- (ptiy) is continuous in the interval [0, oo). For each t>0, 
let 

(t) = max{n > 1 : t„ < t} 
with the convention that max0 = 0. We can see that 

The jump dynamics are captured by {rt{y,C),t > 0,y € V, C C V}. For 
each i > 0, y S V, C C V, rt{y, C) is the conditional probability that a jump 
leads to a state in C, given that the jump occurs at time t from state y. 
Let y = {o!,x,J2i=i^Ui,Yl'^j=i^Zi)- Recall that there are only three types of 
jump times for the process V. Given that V jumps at time t from state y, 
if we know which type the jump time t is, then we know to which state 
the process V jumps to. For example, suppose that the number k in the 
expression of y is less than N, then, at state y, there is at least one idle 
server. If the jump is due to the new arrival, then the process V will jump 

to state (0,x-|- l,Yli=i^u, + So,Yl''j=i^z, +5o)- Let Pi,P2,P3, respectively, 
be the conditional probability that the jump at time t is due to the arrival 
of a new customer, service completion of a customer in service, the end of 
patience time for some customer in the system, respectively, given that the 
jump occurs at time t from state y. Then the probability measure rt{y,-) 
can be easily written from y and pi, i = 1, 2, 3. 
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The jump time dynamics are captured by the survivor functions {Hs^y{t) : 
< s <t,y gV}, where Hs,y{t) is the conditional probabihty that the time 
for the next jump is more than time t given the state being at y at time s, 
in other words, for y= {a,x,Y!l=iK^-,Y!'j=i^Zi), 



- l-F{a + t-s)^l-G'{u, + t-s) 



(**) 



X 



l-F(a) J-1 l-G^{ui) 
1=1 

l-Cizj + t-s) 



It is easy to see that Hs^y{t) satisfies 

Hs,y{u) = Hs,y{t)Ht^^^_^(^y){u), s<t<u. 

Then by Theorem 7.3.2 of [11], y is a piecewise deterministic Markov pro- 
cess constructed from {(r^, Pn),n'>0} using functions <j)t for the determinis- 
tic part, survivor functions H^^y for jump time distributions and transition 
probabihties rt for the jumps. Thus it fohows from Theorem 7.5.1 of [11] 
that y is a strong Markov process. The second part of the lemma follows 
directly from the definition of the {Pt,t > 0} in (B.2). □ 



Remark B.2. For future purposes, we note that the results of this pa- 
per including, in particular, the strong Markov property established above, 
continue to be valid if the state component introduced in Section 2.1 
is, instead, defined as follows: 

(TV). ^^ fs, if ^(^)(s) = 0, 

\mf{u>s:E(^\u)>E(^\s)}-s, if^W(s)>0. 

Observe that when E^^\s) > 0, a^^\s) represents the time from s until 
the next arrival, and if E^^^ is a renewal process, then is simply the 
forward recurrence time process. A minor variation of the proof of Lemma 
B.l given above shows that the strong Markov property holds in this case 
as well. First, the definition of (ptiu) should be modified by replacing a + t 
by a — i in (*). With V, rt and pi, p2, Ps defined as before, in this case, the 
probability measure rt{y, ■) can be easily determined from y, the distribution 
of the remaining time from t to the next arrival and pi, i = 1,2,3. Note that 
if a > at time t, then pi = 0. On the other hand, if a = at time t, then 
V jumps at time t due to the arrival of a new customer, and, hence, pi = l. 
Moreover, given that V jumps at time t from state y, if the type of the jump 
at time t is known, then it is possible to determine the state to which the 
process V jumps. For example, suppose that the number k in the expression 
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for y is less than N . Then, at state y, there is at least one idle server. If the 
jump is due to a new arrival, then the state V will jump to the region {c € 
[0, oo) : (c, x + 1, '}2i=i ^ui+^o, '}2j=i ^Zi+^o)} according to the distribution of 
the time to the next arrival (which is determined by the current state a due 
to the assumption that ct^^ is Markov with respect to its own filtration). 
Once again, the jump time dynamics are captured by the survivor functions, 
with the only difference that now the ratio (1 — F{a + t — s))/{\ — F{a)) on 
the right-hand side of (**) should be replaced by ls^a.>t-s}- The rest of the 
proof then follows as before. 
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